I'm planning some extensive A/B testing in 2020 and considering the benefits of setting up AB tests in an Email Program vs. a Smart Campaign.
We are leaning towards setting up AB tests through Email Programs, as the functionality/flow is a bit more user-friendly.
However: I was wondering if there is an easy way to pull vanity & performance metrics (ie. Open Rate, CTR, Bounce Rate, etc) for emails that are run through an AB test through Email Programs -- for each email/factor we're testing. The dashboard for the post mortem AB test from an Email Program is extremely helpful, but when you export the "raw data", it's quite confusing and hard to interpret (see sample below):
For the purposes of ongoing reporting to other teams, it's important for us to be able to share out these core metrics (like open rates, CTR, etc.).
I know that you can pull performance by setting up an Email Performance Report, but this does not break out the performance of each email or factor we're testing (and treats the email as "one").
Does anyone have any suggestions for how to get these performance metrics when running AB tests through email programs?
... View more
I'm trying to set up an A/B test using custom parameters. I'm testing two CTA buttons.
The CTA buttons contain tokens (not an actual link). I set up the custom conversions to determine a winning CTA, which reference the tokens in the button (in this case the tokens point users to a custom survey link). See screenshot below:
When I ran the test, it looks like the custom conversion parameters were not set up correctly, as no token clicks were captured.
Does anyone have suggestions for how to set up this test more effectively? Thanks in advance!
... View more