Email Program selecting incorrect winner of A/B test

Highlighted
Level 10 - Champion Alumni

Email Program selecting incorrect winner of A/B test

We included an A/B test for an email program last week.  Subject line (B) was the clear winner, yet Marketo identified subject line (A) as the winner.  I’m assuming then that Marketo sent the email with subject line A to the rest of the audience.  Has anyone else experienced this?

0EM50000000RYlO.jpg
0EM50000000RYlT.jpg
Tags (1)
5 REPLIES 5
Highlighted
Anonymous
Not applicable

Re: Email Program selecting incorrect winner of A/B test

Hi Dan,

Could you please log a support ticket for this issue?

Thanks,
Cheryl
Highlighted
Level 10 - Champion Alumni

Re: Email Program selecting incorrect winner of A/B test

I did, Cheryl, but was just wondering if anyone had experienced this in the meantime. I just received this from Support: "This was a bug that was escalated to Engineers and fixed last week. Your email program ran on 2/25-2/26, just before this was reported as fixed."
Highlighted
Level 10 - Champion Alumni

Re: Email Program selecting incorrect winner of A/B test

BTW, when these bugs/issues are identified, can Marketo alert its customers so that they refrain from using these capabilities/features until they have been fixed?
Highlighted
Anonymous
Not applicable

Re: Email Program selecting incorrect winner of A/B test

We definitely do that when possible.  In this case, the issue was fixed by the time I found out about it.  















Highlighted

Re: Email Program selecting incorrect winner of A/B test

We had this issue too, Dan.