Hi All,
I ran the A/B Testing on whole email. However, didn't choose any winner criteria because I have tested it on 100% audience.
But in the final report Marketo has declared an email as winner with winning criteria as Clicks.
In the report, it is showing equal clicks against both the emails. Below is the dashboard view.
Can anyone please let me know the reason behind this?
Thanks.
Solved! Go to Solution.
I tried recreating this in my sandbox instance and Marketo picked the winner email based on # of opens and the same was displayed in the winner notification email as well.
As you'd know by default, Marketo uses Opens as the winner criteria. However, if a user, before adjusting the test sample size to 100% on the Test Settings page goes on the Winner Criteria page and updates the winner criteria to Clicks (or any other criteria as a matter of fact), then Marketo would use the selected criteria while determining the winner and same will be displayed in the winner notification email as well.
But, IMO the winner criteria don't matter when you've chosen to send the test versions to everyone as no one would receive the winner email post Marketo chooses one using the winner criteria anyway.
I tried recreating this in my sandbox instance and Marketo picked the winner email based on # of opens and the same was displayed in the winner notification email as well.
As you'd know by default, Marketo uses Opens as the winner criteria. However, if a user, before adjusting the test sample size to 100% on the Test Settings page goes on the Winner Criteria page and updates the winner criteria to Clicks (or any other criteria as a matter of fact), then Marketo would use the selected criteria while determining the winner and same will be displayed in the winner notification email as well.
But, IMO the winner criteria don't matter when you've chosen to send the test versions to everyone as no one would receive the winner email post Marketo chooses one using the winner criteria anyway.
Thanks Alot, Darshil!
It makes my doubt clear...
Thanks.