Glossary¶

This glossary defines key terms used in A/B testing and throughout the BoastPress AB Testing documentation.

A/B Testing Terms¶

A/B Test¶

A method of comparing two versions of a webpage or element to determine which one performs better in terms of a specified goal, such as clicks, form completions, or purchases.

A/B/n Test¶

An extension of A/B testing that compares more than two variations (n represents any number of variations).

Bucket¶

In BoastPress AB Testing, a bucket is a user segment defined by specific criteria such as query parameters, cookies, HTTP headers, or IP ranges.

Confidence Level¶

The statistical probability that the observed difference between variations is not due to random chance. Typically expressed as a percentage (e.g., 95% confidence).

Control¶

The original version of the content being tested, often referred to as "Version A" or the baseline against which other variations are compared.

Conversion¶

A desired action taken by a user, such as making a purchase, signing up for a newsletter, or completing a form.

Conversion Rate¶

The percentage of visitors who complete a desired action. Calculated as (Number of Conversions / Number of Impressions) × 100%.

Conversion Rate Optimization (CRO)¶

The systematic process of increasing the percentage of website visitors who take a desired action.

A small piece of data stored in a user's browser that helps track their interactions with a website. BoastPress AB Testing uses cookies to maintain consistent user experiences and track conversions.

Hypothesis¶

A testable prediction about how a change to a webpage element will affect user behavior or conversion rates.

Impression¶

An instance of a test variation being shown to a user.

Multivariate Test¶

A test that evaluates multiple variables simultaneously to determine which combination performs best.

Sample Size¶

The number of visitors or impressions included in a test. Larger sample sizes generally provide more reliable results.

Session¶

A period of continuous activity by a user on a website. In BoastPress AB Testing, session-based tests show the same variation to a user throughout their session.

Split Test¶

Another term for A/B testing, where traffic is split between two or more variations.

Statistical Significance¶

The likelihood that the difference in performance between variations is not due to random chance. A test reaches statistical significance when the confidence level meets or exceeds a predetermined threshold (typically 95%).

Variant¶

An alternative version of the content being tested, often referred to as "Version B" (or C, D, etc. for multiple variants).

BoastPress AB Testing Specific Terms¶

AJAX Mode¶

A content delivery method that loads test variations after the page has rendered, making it compatible with caching plugins and CDNs.

Bucket Rules¶

Conditions that determine which users are placed into specific buckets for targeted testing.

Default Version¶

The version that is shown when a test is paused, when a user doesn't qualify for the test, or when there's an error in test delivery.

Impression-Based Testing¶

A testing mode where users may see different variations on each page load.

Session-Based Testing¶

A testing mode where users see the same variation throughout their session for a specified duration.

Session Duration¶

The length of time a user remains in the same test group for session-based tests, configured in hours.

Test Mode¶

The method used to assign users to variations, either impression-based or session-based.

Version Assignment Mode¶

The method used to determine which variation a user sees, either random or bucket-based.

Technical Terms¶

Conversion Page¶

The URL path where conversions are tracked, typically a "thank you" page or confirmation page.

Conversion Tracking¶

The process of recording when users who have seen a test variation complete a desired action.

A browser security feature that controls when cookies are sent with requests to external sites. BoastPress AB Testing uses this to enhance cookie security.

Fragment Caching¶

A caching technique that allows parts of a page to be cached while other parts remain dynamic.

Shortcode¶

A WordPress feature that allows you to add complex functionality to your content using simple code snippets. BoastPress AB Testing uses the [ab_test] shortcode to display test content.

Transient¶

A WordPress feature for temporarily storing cached data in the database. BoastPress AB Testing uses transients to improve performance.

Statistical Terms¶

Bayesian Statistics¶

A statistical approach that updates probabilities as more data becomes available, often used in advanced A/B testing.

Confidence Interval¶

A range of values that is likely to contain the true value of a parameter, such as the true conversion rate.

Minimum Detectable Effect¶

The smallest improvement in conversion rate that you want to be able to detect with your test.

p-value¶

The probability of obtaining test results at least as extreme as the observed results, assuming the null hypothesis is true. Lower p-values indicate stronger evidence against the null hypothesis.

Standard Deviation¶

A measure of the amount of variation or dispersion in a set of values. In A/B testing, it helps determine the reliability of test results.

Type I Error¶

Incorrectly rejecting a null hypothesis (false positive), such as declaring a variation the winner when there is no real difference.

Type II Error¶

Incorrectly accepting a null hypothesis (false negative), such as failing to detect a real difference between variations.

Business Terms¶

Key Performance Indicator (KPI)¶

A measurable value that demonstrates how effectively a company is achieving key business objectives. Common KPIs for A/B testing include conversion rate, revenue per visitor, and average order value.

Return on Investment (ROI)¶

The ratio between the net profit and cost of investment. In A/B testing, ROI measures the value gained from testing efforts compared to the resources invested.

User Experience (UX)¶

The overall experience a user has when interacting with a website or application, including usability, accessibility, and satisfaction.

Value Proposition¶

The promise of value to be delivered to customers, often tested in A/B tests to determine which messaging resonates best with users.

In the next section, we'll cover support resources and how to get help with BoastPress AB Testing.