Issue
A/B test in Email Program status is still showing “Running test…” and not all email variants were sent as expected.
Environment
- A/B Test
- Email Program
- Sample Size
- Running Test
Solution
To ensure the sample size qualified at least a minimum of the total variants of the A/B test.
For example, if you have a total of 6 records, a sample size of 34% will suffice for 2 records (1 for variant A and 1 for variant B).
Root Cause
This can occur if the sample size selected is too small.
For example, if you have a total of 6 records, a sample size of 1% will not suffice for 1 record.
.png)