SOLVED

A/B Testing Question

Go to solution
Anonymous
Not applicable

A/B Testing Question

I scheduled an email to go out this morning and activated A/B testing and had Marketo automatically declare the winner.  The testing has finished and declared a winner, but it does not appear the winning email went to the remaining 90% of my contacts.  How do I make this happen?  I thought Marketo automatically sent the winning email test to the remaining contacts...

1 ACCEPTED SOLUTION

Accepted Solutions
Anonymous
Not applicable

Re: A/B Testing Question

Christina Trujillo​,

Let's take a look at the easier options first.  There is an option on the A/B Test setup where you select whether the winner will be declared automatically or manually.​ 

pastedImage_0.png

If Automatic was selected, the schedule step will allow you to set a time for the winner be sent to the remaining 90%:

pastedImage_3.png

If Manual was selected, only the report/notification can be scheduled:

pastedImage_4.png

So, verify whether it's one of these two things; either the A/B Test was setup as manual and you will need to go into the program and send the winning email to the remaining audience, or the date set to send the winning email is for a later date.  That's you're starting point.  I hope that helps!

Jace

View solution in original post

4 REPLIES 4
Anonymous
Not applicable

Re: A/B Testing Question

Christina Trujillo​,

Let's take a look at the easier options first.  There is an option on the A/B Test setup where you select whether the winner will be declared automatically or manually.​ 

pastedImage_0.png

If Automatic was selected, the schedule step will allow you to set a time for the winner be sent to the remaining 90%:

pastedImage_3.png

If Manual was selected, only the report/notification can be scheduled:

pastedImage_4.png

So, verify whether it's one of these two things; either the A/B Test was setup as manual and you will need to go into the program and send the winning email to the remaining audience, or the date set to send the winning email is for a later date.  That's you're starting point.  I hope that helps!

Jace

Anonymous
Not applicable

Re: A/B Testing Question

Thanks Jace!  As it turns out, Marketo did send the remaining emails but when I went to the dashboard to see the stats of the winning email, the drop down list only showed the test email campaign and "None" as another option.  I had to select the "None" option which is sort of weird because "None" implies there would be nothing there.  I wish Marketo would change the change the drop down menu option from "None" to something more descriptive.

Anonymous
Not applicable

Re: A/B Testing Question

The "Winner Criteria" option is no longer available in our Marketo instance.  How do you set the details of the Criteria, specifically to have Marketo automatically select and send the winner, in the current (August 2015) version?

Anonymous
Not applicable

Re: A/B Testing Question

That's very interesting, Suzanne Scanlan​.  I would like to see a screenshot of what you see when you set up an A/B test.

If your creation steps look like this showing steps 3 and 4,

pastedImage_0.png

I'd say your browser is having some rendering issues and Step 2's Winning Criteria is simply not displaying.

But if the steps don't skip and show 1-3 while skipping the Winning Criteria,

pastedImage_2.png

it may be the service level or Marketo package that was purchased.