A/B Testing - results

OI_MEI_Lee
Level 2

A/B Testing - results

I'm working on a subject line A/B testing and decide to select Opens as the winning criteria but wondering what if the results end up 50/50, how do we define the winning email then?

Tags (1)
1 REPLY 1
Jessica_Kao3
Level 10 - Champion Alumni

Re: A/B Testing - results

Hi Maggie,

You want to make sure that your sample size is large enough so you could run the test again, or it could simply mean that there is no difference.  If you are asking from a Marketo functionality how a winner is chosen, that's a different question entirely.  The likelihood of it being exactly 50.50 is pretty rare.  If you are choosing the winner manually and you get those results it means it doesn't matter and you can go with either one. 

I just wrote a blog on this topic.  You can find that here.  https://nation.marketo.com/community/champion/blog/2016/09/27/how-to-make-the-most-out-of-marketo-ab...