Frequently Asked Questions¶
This section answers common questions about BoastPress AB Testing.
General Questions¶
What is A/B testing?¶
A/B testing (also called split testing) is a method of comparing two or more versions of a webpage or element to determine which one performs better. You show different versions to similar visitors at the same time and measure which version has a better conversion rate.
How is BoastPress AB Testing different from other A/B testing tools?¶
BoastPress AB Testing is specifically designed for WordPress, offering:
- Server-side testing (not just JavaScript overlays)
- Cache compatibility through AJAX mode
- User bucketing for targeted testing
- WordPress-native implementation
- No external service dependencies
- No monthly fees
Does BoastPress AB Testing slow down my website?¶
The plugin is designed for minimal performance impact:
- Non-AJAX mode adds negligible overhead
- AJAX mode adds a small client-side request
- Database queries are optimized and cached
- No external API calls are made by default
For high-traffic sites, we recommend using AJAX mode with browser caching enabled.
Can I use BoastPress AB Testing with caching plugins?¶
Yes, when using AJAX mode. The plugin is compatible with:
- WP Super Cache
- W3 Total Cache
- WP Rocket
- LiteSpeed Cache
- And most other caching solutions
See the Implementing Tests section for configuration details.
Setup and Configuration¶
How many tests can I create?¶
There is no limit to the number of tests you can create in either the free or Pro version.
How many variations can I have per test?¶
- Free version: Up to 2 variations per test (A/B testing)
- Pro version: Unlimited variations per test (A/B/n testing)
Can I test multiple elements on the same page?¶
Yes, you can add multiple shortcodes on the same page to test different elements independently.
Do I need to know how to code to use this plugin?¶
No, the plugin is designed to be user-friendly for non-developers. The visual editor makes it easy to create and manage tests without coding knowledge.
Can I use BoastPress AB Testing with page builders?¶
Yes, the plugin works with all major page builders:
- Elementor
- Beaver Builder
- Divi Builder
- WPBakery Page Builder
- Gutenberg
Simply add the shortcode to a text or HTML element in your page builder.
Testing Methodology¶
How long should I run a test?¶
For statistically significant results, we recommend:
- At least 1-2 weeks (to account for day-of-week variations)
- Until you have at least 100 conversions per variation
- Until you reach statistical significance (95% confidence or higher)
See the Best Practices section for more details.
How do I know when a test is statistically significant?¶
The plugin calculates statistical significance automatically. A test is generally considered statistically significant when:
- The confidence level is 95% or higher
- You have a sufficient sample size (typically 100+ conversions per variation)
- The results have been stable for several days
Can I test different content for different user groups?¶
Yes, using the bucket rules system. You can create rules based on:
- Query parameters
- Cookies
- HTTP headers
- IP ranges
This allows you to target specific user segments with different content.
What's the difference between impression-based and session-based testing?¶
- Impression-based testing: Users may see different variations on each page load
- Session-based testing: Users see the same variation throughout their session
Choose impression-based for testing elements that don't require consistency across pages, and session-based for testing elements that should remain consistent throughout a user's visit.
Technical Questions¶
How does the plugin track users?¶
The plugin uses cookies to track:
- Which variation a user has seen
- When they saw it
- Whether they converted
For session-based tests, the cookie persists for the configured session duration. For impression-based tests, the assignment may change on each page load.
Is the plugin GDPR compliant?¶
Yes, the plugin is designed with privacy regulations in mind:
- Cookies are set with the SameSite attribute
- No personal data is stored
- Cookies are essential for functionality (but can be mentioned in your cookie policy)
- No data is sent to external services
Can I use the plugin with multilingual sites?¶
Yes, the plugin works with multilingual sites. You can:
- Create separate tests for each language
- Use language-specific bucket rules
- Integrate with WPML, Polylang, and other translation plugins
Does the plugin work with multisite installations?¶
Yes, the plugin works with WordPress multisite installations. Each site in the network can have its own tests and configurations.
Troubleshooting¶
My test isn't displaying on my website¶
Check these common issues:
- Verify the test is set to "Active" status
- Ensure the shortcode is correctly formatted
- Check that at least one version is set as the default
- For AJAX mode, check for JavaScript errors
See the Troubleshooting section for more details.
Conversions aren't being tracked¶
Check these common issues:
- Verify the conversion page URL is correct
- Ensure cookies are not being blocked
- Check that the session duration is appropriate
- For AJAX mode, verify that JavaScript is working
See the Troubleshooting section for more details.
The plugin conflicts with another plugin¶
If you experience conflicts:
- Temporarily disable other plugins to identify the conflict
- Check for JavaScript errors in the browser console
- Verify that jQuery is properly loaded
- Check for plugins that might block AJAX requests
See the Troubleshooting section for more details.
Pro Version¶
What are the limitations of the free version?¶
The free version limits you to:
- 2 variations per test
- Basic targeting options
- Standard statistics
- Community support
See the Upgrading to Pro section for a detailed comparison.
How do I upgrade to the Pro version?¶
You can upgrade through:
- The plugin's settings page
- Our website at boast.press/purchase
See the Upgrading to Pro section for detailed instructions.
Will my existing tests work after upgrading to Pro?¶
Yes, all your existing tests, variations, and data will be preserved when upgrading to Pro. The upgrade simply unlocks additional features without disrupting your existing setup.
Usage Scenarios¶
Can I use the plugin for email marketing optimization?¶
Yes, you can test different landing pages for email campaigns by:
- Creating different variations of your landing page
- Adding UTM parameters to your email links
- Using bucket rules to target users coming from those links
Can I test WooCommerce product pages?¶
Yes, you can test various elements on WooCommerce pages:
- Product descriptions
- Pricing displays
- Add to cart buttons
- Product images
- Checkout process
Can I test membership or subscription pages?¶
Yes, the plugin is ideal for optimizing conversion pages for memberships or subscriptions. You can test:
- Pricing tables
- Feature lists
- Sign-up forms
- Testimonials
- Guarantee statements
Can I use the plugin for personalization?¶
Yes, using bucket rules, you can deliver personalized content based on:
- User behavior
- Traffic source
- Geographic location
- Previous interactions
- Custom parameters
Support and Resources¶
Where can I get help if I have a problem?¶
- Free version users: WordPress.org support forum
- Pro version users: Priority email support
See the Support section for more details.
Where can I request new features?¶
You can request features through:
- Community Roadmap
- Your account dashboard (Pro version)
- Email to [email protected]
In the next section, we'll provide a glossary of terms used in A/B testing and throughout this documentation.