2 Replies Latest reply on Sep 12, 2016 10:32 AM by Neeraj Shahdadpuri

    Split test entire campaign / flow

    0b1882bf65247ec5a4ad041541ce06aaef6e3bcb Sep 11, 2016 7:47 PM

      Hi everyone,

       

      I need to test a Campaign Flow, rather than a single email. Here's the scenario:

       

      - I want to test on-boarding members via just email vs email + print (as in, actual physical postcards etc by snail mail)

      - On one Campaign or one Flow I would have just the welcome email

      - On the other Campaign or Flow would have the same email plus a webhook that sends some data to the printer

      - Then compare them for a period and monitor their conversion rate or the retention rates as the case may be

       

      I haven't found anything that shows how to test anything outside of RTP or emails. Is my scenario feasible?

       

      Many thanks!

      • 51 Views
      • Tags:
        • Re: Split test entire campaign / flow
          Rachel Egan
          Rachel Egan Sep 12, 2016 10:21 AM (in response to 0b1882bf65247ec5a4ad041541ce06aaef6e3bcb)

          If I'm reading your question properly, I believe you can set up a random sample to be sent to one campaign vs the other. I would randomly split my sample into even groups and add them to a list, then I would run one list through one campaign flow and the other through a different one. You should then be able to monitor the lists and their performance as far as conversion and retention rates go.

           

          It's going to be relatively manual as far as reporting goes, however it is possible.

          1 of 1 people found this helpful
          • Re: Split test entire campaign / flow
            Neeraj Shahdadpuri
            Neeraj Shahdadpuri Sep 12, 2016 10:32 AM (in response to 0b1882bf65247ec5a4ad041541ce06aaef6e3bcb)

            You can do a random split of your target audience and add them to two lists. Use each list in two different smart campaigns, one for Email and one for email + webhook. You can report on the LP conversions/email clicks/link visits/web page visits using respective filters and adding a filter of member of smart campaign for email and email+webhook campaigns. You can create lists/lead reports based on the same, one list/report using respective conversion parameter filter and member of smart campaign for email only & another list/report using respective conversion parameter and member of smart campaign for email + webhook.