AnsweredAssumed Answered

Email A/B Testing doesn't seem to work.

Question asked by Dylan Teo on Aug 31, 2018
Latest reply on Sep 13, 2018 by Dylan Teo

Hi all,

 

I set up an email program and Subject Line A/B Test with a 50/50 weight. However, the results show that only the Champion has been getting clicks while the Challenger hasn't received any at all. It seems likely that none of the people in the smart list are receiving the challenger emails at all.

 

Screen Shot 2018-08-31 at 1.53.36 PM.png

 

The A/B Test was a Subject Line test with a 50/50 weight.

 

Untitled 2.png

For the email program flow, I used "EMAIL-Invitation 01" as "EMAIL-Invitation 01.Subject Line" was not available in the dropdown list.

 

Untitled.png

 

Does anyone have any idea why this is happening and what can be done to rectify it?

 

I have referenced these two articles to no avail as the solutions provided don't offer much detail:

A/B Testing vs. Champion/Challenger Emails

A/B testing - am I doing something wrong?

 

I would sincerely appreciate any help on this.

Outcomes