How to A/B test two different flows?

Anonymous
Not applicable

How to A/B test two different flows?

Hi everyone,

I want to test informal text based emails versus marketing welcome emails for new users. I have 7 emails set and would convert them to text only for the text only flow. So the idea is that half the users go into the text only flow, and the other half go into the marketing flow with more images and dynamic template. The question is - what is the best way to test that for incoming users? I have two ideas but am open to hearing more.

Idea 1 - we split the incoming list based on the 'email address starts with a-m' who all get Text Only Email 1, and email starting with n-z get Marketing Email 1, and so on to both versions of Email 7.

Idea 2 - In Step 1 - random sample is 50 receives Text Only Email 1 and default is Marketing Email 1. Step 2 - If user received Text Only Email 1, send Text Only Email 2, default is Marketing Email 2, and so on to both versions of the email 7. I've attached a screenshot of what the Idea 2 flow would look like.

Open to trying other ways, or anyone to poke holes in this logic.

Thanks marketo peeps!

Inni

2 REPLIES 2
Erica_Dipyatic
Level 3

Re: How to A/B test two different flows?

Hey Inni Chowdhury

I'd post your question in the Products Discussion feed(s). You're more likely to get an answer or feedback vs from this group which is focused on information related to, and studying for, the MCE.

Anonymous
Not applicable

Re: How to A/B test two different flows?

Thank you, I'll do that.