Is it possible to A/B test emails in an Engagement program, and if so, how?
Thanks!
Solved! Go to Solution.
Let me clarify: if you're using just emails in your EP, C/C will work. If you're using programs within your EP, C/C is not supported since the emails are being sent as a batch each cast.
Malik Zafar you don't need to use the Email Program to A/B test emails. You could also use the "Random Sample" option in your program.
Colin Ryder we manually A/B test our blasts and nurtures! I'd love to hear more about your challenges. Here's the template we use to track our email A/B tests. I'm posting a blog post on how we A/B test our emails very soon. I'll be sure to share it with you!
Yes please
you're able to A/B test emails nested inside a program that are a part of an engagement program? Just wondering how you're able to actually test this properly with Marketo
Malik Zafar I don't nest programs inside any engagement program. But yes, I create a Random Sample 50/50 campaign to send two different emails. I *don't* use the Email program feature!
As long as your emails aren't being batch sent. C/C only works with trigger based emails. And of course you cannot use an Email Program in an EP.
Let me clarify: if you're using just emails in your EP, C/C will work. If you're using programs within your EP, C/C is not supported since the emails are being sent as a batch each cast.
Hmm interesting. Yea, all of our emails in our Engagement Program are nested inside of a program - so with that being said, it looks like A/B testing is not possible, correct?
You can still use 'random sample' with your Send Email in your flow step and determine the percentage received for both groups.
that's correct.
Hi Malik,
You can use the Champion/Challenger method for testing. This creates a test as a sub-asset to a specific email so when you put that email in your engagement program it will call the test whenever it's sent.
Email Tests - Champion/Challenger - Marketo Docs - Product Docs
Hey John,
What happens if the email that is used in an engagement program is used in multiple streams? For instance, if the email is used in stream one, and then again in stream 3, and the lead received the email in stream one with subject line A, would the program call the email with subject line B in stream 3?
Thanks,
Alex