Hello,
We are currently working to outline A/B testing that will test eight different variations of the subject line in our email. To my understanding there are two ways to do this:
a) We set this up utilizing the A/B test functionality within Marketo.
b) We clone and modify eight separate emails, and do analysis manually.
My question is whether or not there are cons to using the built in A/B testing split in Marketo. We want to be able to look at specifics of who the contacts responding to each variation are, and want to ensure we won't have any restrictions to the type of data we can see.
Thanks in advance for any responses.
You will be able to see who received the varients in the standard A/B testing. The only con is that the test will run for a specific amount of time before the winner is sent to the remaining members of the target audience. You could actually just set the test to 100% so that all people recieve the original test. My only concern with an 8 subject test is that you have a list large enough to provide you with meaningful results.