Provide automated A/B testing outside of Email Programs

[Dan_Stevens_]

I'm familiar with the Champion/Challenger A/B test approach that's available for emails that are part of normal programs (not the new Email Program).  What I'd like to see is the same capabilitiy that the new Email Program has - the ability to initially define a small sample size (and testing criteria), and then after a defined period, AUTOMATICALLY send out the winning email to the rest of the audience (instead of having to manually declare a winner).

[Dan_Stevens_]

Is this, by chance, on Marketo's roadmap for 2016?  More and more of our stakeholders are demanding A/B testing of their emails before they are sent to the masses.  The majority of our emails are sent via Engagement Programs.

[Grégoire_Miche2]

The way it could be implemented in engagement programs is described here :

[Grégoire_Miche2]

The key point, if we want it for Default and Event programs is how we can design something that fits within smart campaign flows and switches automatically to the winner.

It could take the form a new "Email A/B test" flow step, or a button in the send email flow step. The flow would continue immediately for the leads in the sample (they have been sent immediately), but would wait until email is actually sent for the emails that are not in the sample and are waiting to receive the winner.

The A/B test would only run until enough leads have received the sample, even is the smart campaign is ran multiple times. For instance, if a smart campaign has a A/B test flow step with a 1000 leads sample, and if the first run of the SC targets 6000 leads, the following runs would not send A & B, only the winner.

A warning would be raised when launching the smart campaign if the number of leads in the target is lower that the sample size, but this warning would no prevent running it.

My 2 cents.

-Greg