Trouble with A/B Testing Results

[Anonymous]

Hi all. Has anyone experienced issues with A/B testing results not being sent to an entire database? I am working to submit a support ticket, and I was wondering if anyone had any tips or similar experiences with A/B test results not working properly.

[Anonymous]

Hi all,

Update on the testing: Looks like our consultant said it's a visual "glitch." I'm going to chat with a Marketo representative shortly and show him my screen. I should have more updates as we learn more about the glitch.

Thanks all,

Jack

[Anonymous]

Thanks, everyone, for providing insight. We opened a Marketo case, and according to support, it looks like the email wasn't in the approved state. I sent them the attached screen shot, so hopefully they will provide some insight.

[Sara_Greaves]

Definitely keep us updated!

[Sara_Greaves]

Hi Jack,

Can you clarify your question a little further? Do you mean that a "winner" was not sent to the rest of your target list?

[Anonymous]

Hi Sara,

Correct, I don't think the winner is being sent to the rest of the list. When I look at the mailbox icon, it still has a clock around the icon.

[Jessica_Kao3]

How long did you set the test up for?  The minimum is four hours.  So if you launch the test at 6am, the winner at the earliest won't be sent until 10am. 

Did you have the winner declared manually or automatically?

[Anonymous]

Hi Jessica,

We set up the test so that after 24 hours, it would go to our audience. Attached are two screenshots of a quarterly newsletter that didn't go out to the remaining of our database.

[Anonymous]

We also set up on our end that the winner would be automatically sent. Is there an option in Marketo to review that?

[Dayna_Wellman3]

I agree with Jessica, I think the program is stuck. Email programs follow the Campaign Limit that is set up in your Admin. You can read more about it here. If your email campaign is trying to send to more people than your Campaign Limit allows, it will fail. They usually will fail on their own, but it might take a while.

[Jessica_Kao3]

It does look like the test is still running.  I think the test is  stuck which would warrant a support ticket.   You can see that the test is still running and a winner hasn't been declared.   I'm assuming clicks to open with a 3 subject line test.  Time to call support on this one I think. 

[Sara_Greaves]

Okay. How long ago did you set up the email? I notice that I get that symbol sometimes if I don't refresh after launching a campaign. I know that's not a technical response, but it's worth mentioning. We can also investigate your set up. I'm assuming that you were doing a test and set the test percentages. What percentage of your target list did you send to each group? If you did a 50-50 split, there's no leads left in your target list to send the winner to. The more detail you can give, the better