AnsweredAssumed Answered

Do you let Marketo auto-declare an A/B test winner?

Question asked by Lisa Juley on Apr 26, 2018
Latest reply on Apr 27, 2018 by Lisa Juley

The reason I ask is that I've just submitted a support case that shows highly contradictory evidence that the testing dashboard data is accurate.

 

This was a whole email test with option A being HTML and B being text-only.  Marketo's out of the box reporting shows 3 opens for B and zero conversions for either option.

 

However, after digging into the overall conversions for the past 24 hours (below) I was able to find 6 total conversions.  Digging into the individual's Activity History confirms they converted from this campaign.

 

Any thoughts?  Should I just conduct my own research to manually declare the winner going forward?  And if I have to do that, what good is the reporting provided?

 

Thanks in advance.

  

2018-04-25 11:17:16: Downloaded A Corporate Counsel's Guide to Successful Contract Lifecycle ManagementB
2018-04-25 11:18:42: Downloaded A Corporate Counsel's Guide to Successful Contract Lifecycle ManagementA
2018-04-25 11:28:31: Downloaded A Corporate Counsel's Guide to Successful Contract Lifecycle ManagementB
2018-04-25 11:49:55: Downloaded A Corporate Counsel's Guide to Successful Contract Lifecycle ManagementB
2018-04-25 13:25:31: Downloaded A Corporate Counsel's Guide to Successful Contract Lifecycle ManagementB
2018-04-26 03:06:19: Downloaded A Corporate Counsel's Guide to Successful Contract Lifecycle ManagementA

Outcomes