A/B testing follow up emails

[Anonymous]

Hi!

I am sending out an email to get people to download our new white paper. If they download the white paper, we want to send them a follow up email to visit our white paper hub - however for this follow up email we have two different designs we want to test.

Is it possible to split test a follow up email? The flow would be:

Send email
Wait 1 week
If opened email > send follow up email (this is where we want it to split test the follow up email)

Hopefully that makes sense... Please help!

Thanks
Hannah

[Anonymous]

You can use 'Random split' function of 'Add to List' flow action. For 'Add to List' flow action, select 'Add Choice' and in the drop down select 'Random sample' and for 'Random sample' is '50', put in list A and 'Random sample' is '50', put in list B.

Then you can send different emails to list A and list B people. Some thing like,

Let me know if this helps.

Rajesh

[Anonymous]

Hi Hannah,

I think your best bet here would be to use the "Request Campaign" flow action on a new smart campaign with the emails split 50/50.

It would look something like this:

Original Campaign
Send Email
Wait 1 Week
If opened email > Request Campaign "Campaign Name"

New Campaign
*Smart List
Campaign is Requested via Marketo Flow Action
*Flow
Send Email > Random Sample is 50-Send Email 1
                     Else Send Email 2

[Anonymous]

FYI ...New AB Split test group and Champion Challenger feature becoming available in our December release!

[Anonymous]

I like Caleb's method too. Splitting them in different lists would make it a bit easier to analyze your A/B testing results.

Rajesh

[Anonymous]

Hi all

Thanks so much for your help!

Caleb - I'm trying it the way you suggested. We want to only send the follow up email to people who downloaded the white paper from the first email though.

Could I do original campaign as you suggested, the for the follow up split test campaign would it work if I did:

*Smart List
Campaign is Requested via Marketo Flow Action
*Flow
If filled out form > is > white paper form
And recieved email > initial white paper email
Then
Send Email > Random Sample is 50 - Send Email 1
                          Default  - Send Email 2

Thanks!

[Anonymous · Accepted solution]

Hi Hannah,

Yes you could do it that way--it would look like this:

*Smart List
<Trigger>Campaign is Requested via Marketo Flow Action
<Filter>If filled out form > is > white paper form
<Filter>Was Delivered Email > initial white paper email

*Flow
Send Email > Random Sample is 50 - Send Email 1
                     Default - Send Email 2

Is the white paper going to be accessible to everyone? Or would you like to send a follow up to all those who download it (from site and email) to visit the hub?

If so, you could set it up like this:

*Smart List
<Trigger>Fills out form > is > white paper form

*Flow
Wait > 1 Week
Send Email > Random Sample is 50 - Send Email 1
                     Default - Send Email 2

Feel free to set the 'wait' time to a couple minutes to test for yourself to make sure everything's running as you like.

[Anonymous]

Caleb you are the BEST! This is perfect, thank you so much for your help 🙂

[Anonymous]

You're welcome, happy to help! 🙂