A/B Test Significance
Calculate A/B Test Significance instantly with the exact formula and a worked example.
A/B Test Significance
Visitors in variant A
Conversions in variant A
Visitors in variant B
Conversions in variant B
Significance of the difference
94.1742%
Conversion rate A
5%
Conversion rate B
5.6%
z statistic
1.894
p-value
0.0583
Conclusion
Difference is not significant
More about: A/B Test Significance
What it calculates
The “A/B Test Significance” calculator computes Significance of the difference in % from 4 parameters: visitors in variant a, conversions in variant a, visitors in variant b, conversions in variant b.
A core calculation for studying, engineering tasks, and checking solutions.
Example calculation
With parameters Visitors in variant A = 10,000, Conversions in variant A = 500, Visitors in variant B = 10,000, Conversions in variant B = 560 the result is 94.17 %.
How to use
- Enter visitors in variant a, conversions in variant a, visitors in variant b and conversions in variant b — each field above is adjustable with a slider.
- Significance of the difference (%) is calculated automatically as you type.
- Check the worked example below to see the formula applied to real numbers.
- Copy the result or bookmark this calculator.
Related calculators
FAQ
How is A/B Test Significance calculated?
The A/B Test Significance calculator computes Significance of the difference (in %) from visitors in variant a, conversions in variant a, visitors in variant b, conversions in variant b. Enter your values above and the exact formula is applied instantly; a worked example with real numbers is shown below.
Is the A/B Test Significance calculator free?
Yes. It is completely free, needs no signup, runs entirely in your browser, and sends no data to any server.
More calculators in this category
Explore related free tools