Separate A/B Test Data From Sent Winning Data

Separate A/B Test Data From Sent Winning Data

It would be very beneficial if you could see how well you’re A/B test did as well as the results from the winning email separate from the test.

I just completed my first email test that test 2 totally different emails.  I A/B tested 50% of my list and sent the winning email to the reaming 50%. The test ran perfectly, however the reporting on the results is a bit disappointing.

The reporting in the A/B test dashboard is awesome and provides all the high level details (delivered, opens, clicks, unsubs) you need while it’s testing. However, after the test is competed and the winning email is sent to the remaining members of the list, you cannot see the results of that email. All the data is rolled up into one report as if the entire test and winning email was one email. This means that in order to see how well the winning email did with the remaining list, you have back out the high level details from the A/B test dashboard from the more detailed report you get from the email performance report. Which is manually and if you want the data that is in the email performance report you will have do the calculations yourself. It would be helpful if the test data and sent winners data where separate. 
2 Comments
Anonymous
Not applicable
Hi Terry,

Email Analysis in Revenue Explorer allows you to have the reporting for each A/B test variant as well as the winning email, which can be identified by adding Sent Date and/or Sent Hour.

Please see https://community.marketo.com/MarketoResource?id=kA650000000GxN9CAK for more details.

TJ
kh-lschutte
Community Manager
Status changed to: Already have it