A/B Email Testing

A/B Email Testing

Hi everyone,

So I'm a Marketo newbie, (second week on the job) basicaly I am putting together a few A/B test cases. I've read through a lot of the discussions and seen a few ideas, but it seems to me that Marketo way of A/B testing is very backwards, overly complicated and highly time consuming.

Maybe its the way that I am going about it and there might be an easier way.....but would it not be awesome if there was a built in function where we could select a mailing group or currently running campaign and as a feature to it we could select "add test" set our confidence levels, upload our two or three new test emails to our campaign and Marketo from there could from there could automatically assign for example 5% to test email 1 and 5% to test email 2, and the remainder receive the default. From there maybe Marketo could build out results based on current original email "opens, clicks, clicked link etc " versus "Test email 1" & "Test email 2" .

Maybe I'm just a little bit frustrated at the moment and throwing my idea out. Hopefully I got my idea across and some of you kind folks have maybe a better way of doing it or ideas to throw on top of my own idea.

Appreciate if you can share your ideas and experience.

Barry
8 Comments
Anonymous
Not applicable
Hi Barry,

we've been told that this feature is to be released with the December release. I've seen screenshots of it, and it will cover exactly what you describe.

It is even so, that you can 5% to A, 5% to B and Marketo will send the "winner" to the 90% rest group. Whereas the winner is determined automatically based on your parameters.

Have hope!

Michael
Anonymous
Not applicable
Hi Michael,

Thanks for your response. That sounds awesome, great news look forward to getting my hands on it! 

Hopefully they will have approval features before sending the winner to the remainding 90%, it could be the case that your two test emails are actually performing worse then the original email. But I guess thats all defined beforehand in the flows!

Hope has been restored......bring on December!

Many thanks,
Barry

Anonymous
Not applicable
Yes this is confirmed, we are releasing AB Split testing and Champion/Challenger testing in our December release.
Anonymous
Not applicable
Awesome news Cheryl.

Would it be possible to get a few screenshots of how it might look?
Anonymous
Not applicable
I can give you access to AB Split testing today as a pre-release feature.  Send me an email at cheryl@marketo.com
Anonymous
Not applicable
Cheryl,

I would also love a preview if it's possible.  We test often and it is a cumbersome process currently.
Can I just email you?

Cheers!
Patty
Anonymous
Not applicable
Yes, shoot me an email.
kh-lschutte
Community Manager
Status changed to: In Production