4 Replies Latest reply on Mar 6, 2015 7:19 AM by Dory Viscogliosi

    Email A/B Testing - do I really need lists?

    Mark Farnell
      We're A/B testing a 3 week standard mini- drip nurture campaign and a 3 week mini-engagement program.  In each case we're splitting off a region of our sample and running an A/B test (1.1 NAM).

      0EM50000000SyAa

      Essentially, in the first week's flow if the region equals "X" then we request a campaign which sends 50% version A and 50% version B, just using random sample.  Everybody else isn't in the test get a previously approved email (which we are not testing 1.2 ROW above sends a different email to that group)

      0EM50000000SyAV

      Then we wait a week (either by wait step in the dri[p nurture) or by cadence (for the engagement program).  We use a choice step on send email here to say send the 2nd version A email if you have been sent version A of the 1st email, otherwise send version B of the second email.

      0EM50000000SyAf

      And then the same for week 3.

      I don't see why we need to use a list here as recommended by https://community.marketo.com/MarketoArticle?id=kA050000000KytQ or https://community.marketo.com/MarketoArticle?id=kA050000000L6EBCA0.

      Because we are only testing 2 emails I don't see how the lists will help me, but my team have some concerns.  Would appreciate the communities view.

      Pretty much the same process exists in the engagement program - the camapign used in the enaggement program requests similar campaigns to send the email.