Skip to content

Frequently Asked Questions

This section answers common questions about BoastPress AB Testing.

General Questions

What is A/B testing?

A/B testing (also called split testing) is a method of comparing two or more versions of a webpage or element to determine which one performs better. You show different versions to similar visitors at the same time and measure which version has a better conversion rate.

How is BoastPress AB Testing different from other A/B testing tools?

BoastPress AB Testing is specifically designed for WordPress, offering:

  • Server-side testing (not just JavaScript overlays)
  • Cache compatibility through AJAX mode
  • User bucketing for targeted testing
  • WordPress-native implementation
  • No external service dependencies
  • No monthly fees

Does BoastPress AB Testing slow down my website?

The plugin is designed for minimal performance impact:

  • Non-AJAX mode adds negligible overhead
  • AJAX mode adds a small client-side request
  • Database queries are optimized and cached
  • No external API calls are made by default

For high-traffic sites, we recommend using AJAX mode with browser caching enabled.

Can I use BoastPress AB Testing with caching plugins?

Yes, when using AJAX mode. The plugin is compatible with:

  • WP Super Cache
  • W3 Total Cache
  • WP Rocket
  • LiteSpeed Cache
  • And most other caching solutions

See the Implementing Tests section for configuration details.

Setup and Configuration

How many tests can I create?

There is no limit to the number of tests you can create in either the free or Pro version.

How many variations can I have per test?

  • Free version: Up to 2 variations per test (A/B testing)
  • Pro version: Unlimited variations per test (A/B/n testing)

Can I test multiple elements on the same page?

Yes, you can add multiple shortcodes on the same page to test different elements independently.

Do I need to know how to code to use this plugin?

No, the plugin is designed to be user-friendly for non-developers. The visual editor makes it easy to create and manage tests without coding knowledge.

Can I use BoastPress AB Testing with page builders?

Yes, the plugin works with all major page builders:

  • Elementor
  • Beaver Builder
  • Divi Builder
  • WPBakery Page Builder
  • Gutenberg

Simply add the shortcode to a text or HTML element in your page builder.

Testing Methodology

How long should I run a test?

For statistically significant results, we recommend:

  • At least 1-2 weeks (to account for day-of-week variations)
  • Until you have at least 100 conversions per variation
  • Until you reach statistical significance (95% confidence or higher)

See the Best Practices section for more details.

How do I know when a test is statistically significant?

The plugin calculates statistical significance automatically. A test is generally considered statistically significant when:

  • The confidence level is 95% or higher
  • You have a sufficient sample size (typically 100+ conversions per variation)
  • The results have been stable for several days

Can I test different content for different user groups?

Yes, using the bucket rules system. You can create rules based on:

  • Query parameters
  • Cookies
  • HTTP headers
  • IP ranges

This allows you to target specific user segments with different content.

What's the difference between impression-based and session-based testing?

  • Impression-based testing: Users may see different variations on each page load
  • Session-based testing: Users see the same variation throughout their session

Choose impression-based for testing elements that don't require consistency across pages, and session-based for testing elements that should remain consistent throughout a user's visit.

Technical Questions

How does the plugin track users?

The plugin uses cookies to track:

  • Which variation a user has seen
  • When they saw it
  • Whether they converted

For session-based tests, the cookie persists for the configured session duration. For impression-based tests, the assignment may change on each page load.

Is the plugin GDPR compliant?

Yes, the plugin is designed with privacy regulations in mind:

  • Cookies are set with the SameSite attribute
  • No personal data is stored
  • Cookies are essential for functionality (but can be mentioned in your cookie policy)
  • No data is sent to external services

Can I use the plugin with multilingual sites?

Yes, the plugin works with multilingual sites. You can:

  • Create separate tests for each language
  • Use language-specific bucket rules
  • Integrate with WPML, Polylang, and other translation plugins

Does the plugin work with multisite installations?

Yes, the plugin works with WordPress multisite installations. Each site in the network can have its own tests and configurations.

Troubleshooting

My test isn't displaying on my website

Check these common issues:

  1. Verify the test is set to "Active" status
  2. Ensure the shortcode is correctly formatted
  3. Check that at least one version is set as the default
  4. For AJAX mode, check for JavaScript errors

See the Troubleshooting section for more details.

Conversions aren't being tracked

Check these common issues:

  1. Verify the conversion page URL is correct
  2. Ensure cookies are not being blocked
  3. Check that the session duration is appropriate
  4. For AJAX mode, verify that JavaScript is working

See the Troubleshooting section for more details.

The plugin conflicts with another plugin

If you experience conflicts:

  1. Temporarily disable other plugins to identify the conflict
  2. Check for JavaScript errors in the browser console
  3. Verify that jQuery is properly loaded
  4. Check for plugins that might block AJAX requests

See the Troubleshooting section for more details.

Pro Version

What are the limitations of the free version?

The free version limits you to:

  • 2 variations per test
  • Basic targeting options
  • Standard statistics
  • Community support

See the Upgrading to Pro section for a detailed comparison.

How do I upgrade to the Pro version?

You can upgrade through:

  1. The plugin's settings page
  2. Our website at boast.press/purchase

See the Upgrading to Pro section for detailed instructions.

Will my existing tests work after upgrading to Pro?

Yes, all your existing tests, variations, and data will be preserved when upgrading to Pro. The upgrade simply unlocks additional features without disrupting your existing setup.

Usage Scenarios

Can I use the plugin for email marketing optimization?

Yes, you can test different landing pages for email campaigns by:

  1. Creating different variations of your landing page
  2. Adding UTM parameters to your email links
  3. Using bucket rules to target users coming from those links

Can I test WooCommerce product pages?

Yes, you can test various elements on WooCommerce pages:

  • Product descriptions
  • Pricing displays
  • Add to cart buttons
  • Product images
  • Checkout process

Can I test membership or subscription pages?

Yes, the plugin is ideal for optimizing conversion pages for memberships or subscriptions. You can test:

  • Pricing tables
  • Feature lists
  • Sign-up forms
  • Testimonials
  • Guarantee statements

Can I use the plugin for personalization?

Yes, using bucket rules, you can deliver personalized content based on:

  • User behavior
  • Traffic source
  • Geographic location
  • Previous interactions
  • Custom parameters

Support and Resources

Where can I get help if I have a problem?

  • Free version users: WordPress.org support forum
  • Pro version users: Priority email support

See the Support section for more details.

Where can I request new features?

You can request features through:

In the next section, we'll provide a glossary of terms used in A/B testing and throughout this documentation.