SOLVED

A/B Testing in Engagement Programs?

Go to solution
Mikes_Jones
Level 8

A/B Testing in Engagement Programs?

Is it possible to A/B test emails in an Engagement program, and if so, how?

Thanks!

1 ACCEPTED SOLUTION

Accepted Solutions
Dan_Stevens_
Level 10 - Champion Alumni

Re: A/B Testing in Engagement Programs?

Let me clarify: if you're using just emails in your EP, C/C will work. If you're using programs within your EP, C/C is not supported since the emails are being sent as a batch each cast. 

View solution in original post

13 REPLIES 13
John_Clark1
Level 10

Re: A/B Testing in Engagement Programs?

Hi Malik,

You can use the Champion/Challenger method for testing.  This creates a test as a sub-asset to a specific email so when you put that email in your engagement program it will call the test whenever it's sent.

Email Tests - Champion/Challenger - Marketo Docs - Product Docs

Anonymous
Not applicable

Re: A/B Testing in Engagement Programs?

Hey John,

What happens if the email that is used in an engagement program is used in multiple streams? For instance, if the email is used in stream one, and then again in stream 3, and the lead received the email in stream one with subject line A, would the program call the email with subject line B in stream 3?

Thanks,
Alex

Dan_Stevens_
Level 10 - Champion Alumni

Re: A/B Testing in Engagement Programs?

As long as your emails aren't being batch sent. C/C only works with trigger based emails. And of course you cannot use an Email Program in an EP. 

Dan_Stevens_
Level 10 - Champion Alumni

Re: A/B Testing in Engagement Programs?

Let me clarify: if you're using just emails in your EP, C/C will work. If you're using programs within your EP, C/C is not supported since the emails are being sent as a batch each cast. 

Mikes_Jones
Level 8

Re: A/B Testing in Engagement Programs?

Hmm interesting. Yea, all of our emails in our Engagement Program are nested inside of a program - so with that being said, it looks like A/B testing is not possible, correct?

Dan_Stevens_
Level 10 - Champion Alumni

Re: A/B Testing in Engagement Programs?

that's correct.

chriskowalczyk
Level 1

Re: A/B Testing in Engagement Programs?

You can still use 'random sample' with your Send Email in your flow step and determine the percentage received for both groups. 

Anonymous
Not applicable

Re: A/B Testing in Engagement Programs?

Malik Zafar​ you don't need to use the Email Program to A/B test emails. You could also use the "Random Sample" option in your program.

Colin_Ryder
Level 6 - Champion Alumni

Re: A/B Testing in Engagement Programs?

We don't use the email program at the moment so we do the same thing as Allison. A bit more manual but it is an option.

It would be useful if Marketo were to enable A/B testing on batch campaigns as well. There is an idea here so feel free to like it