AnsweredAssumed Answered

Email A/B Testing - do I really need lists?

Question asked by Mark Farnell Expert on Mar 5, 2015
Latest reply on Mar 6, 2015 by Dory Viscogliosi
We're A/B testing a 3 week standard mini- drip nurture campaign and a 3 week mini-engagement program.  In each case we're splitting off a region of our sample and running an A/B test (1.1 NAM).


Essentially, in the first week's flow if the region equals "X" then we request a campaign which sends 50% version A and 50% version B, just using random sample.  Everybody else isn't in the test get a previously approved email (which we are not testing 1.2 ROW above sends a different email to that group)


Then we wait a week (either by wait step in the dri[p nurture) or by cadence (for the engagement program).  We use a choice step on send email here to say send the 2nd version A email if you have been sent version A of the 1st email, otherwise send version B of the second email.


And then the same for week 3.

I don't see why we need to use a list here as recommended by or

Because we are only testing 2 emails I don't see how the lists will help me, but my team have some concerns.  Would appreciate the communities view.

Pretty much the same process exists in the engagement program - the camapign used in the enaggement program requests similar campaigns to send the email.