SOLVED

Re: AB testing subject line

Go to solution
Anonymous
Not applicable

AB testing subject line

Heelo,

I'm new to AB testing in Marketo. I'm setting up an AB subject line test and I have a few questions.
  • When I get to the test settings and I set the percentages. (ie 20% tested 80% not tested). What happens to the 80%? do they get the "default" email?
  • If not, that's what I would want to do. Run the AB subject line test to 20% of our users and send the rest of the users (80%) the regular subject line.
Thoughts?
Tags (1)
1 ACCEPTED SOLUTION

Accepted Solutions
Dory_Viscoglio
Level 10

Re: AB testing subject line

After the testing period which you designate during the AB Test creation step (can be anywhere from 4 hours to several days), the winning subject line will be sent to the 80% who weren't a part of the test. 

View solution in original post

4 REPLIES 4
Dory_Viscoglio
Level 10

Re: AB testing subject line

Phil, are you doing the testing using Marketo's AB testing options using Email Programs, or in a triggered smart campaign? The two options are described here, and it sounds like you want to be doing the second option of the triggered smart campaign.

If it's a one time send, I'd probably recommend breaking your send to list into two bunches, and doing the 80/20 split that way and then manually comparing the results.
Anonymous
Not applicable

Re: AB testing subject line

Thank you for the response. It is starting to make sense.

I am testing in Email Programs. What I want to know is what happens to the non-tested users (the 80% in my example) and when do they get the email? Or do they never get an email?
Dory_Viscoglio
Level 10

Re: AB testing subject line

After the testing period which you designate during the AB Test creation step (can be anywhere from 4 hours to several days), the winning subject line will be sent to the 80% who weren't a part of the test. 
Anonymous
Not applicable

Re: AB testing subject line

Can i add a token in the A/B test subject line - in the A/B set up it doesn't give me the option to bring in the token but i can copy and paste it - with the token render when i send it out properly?