Status: “Running test…” A/B Test

Issue

A/B test in Email Program status is still showing “Running test…” and not all email variants were sent as expected. 

 

Solution

To ensure the sample size qualified at least a minimum of the total variants of the A/B test. 

For example, if you have a total of 6 records, a sample size of 34% will suffice for 2 records (1 for variant A and 1 for variant B). 


 

Root Cause

This can occur if the sample size selected is too small.

For example, if you have a total of 6 records, a sample size of 1% will not suffice for 1 record.

 

Environment

  • A/B Test
  • Email Program 
  • Sample Size
  • Running Test 

Labels (1)