How to setup whole email A/B test with custom conversion?

Level 4

How to setup whole email A/B test with custom conversion?

This may be me, but it sure seems like a bug.  We are trying to create an Email Send with a "Whole Email" A/B Test.  We want to set the winner criteria to be the most clicks to the call to action button, which seems to be pretty straight forward.  (The CTA buttons link to an external client site, so we cannot use any landing page triggers.)

Here's the issue...
1. When we create the emails, add them as the two email in the whole email test, all is well. 


2. Next we choose, the Winner Criteria...


3. We select the "Clicks Link in Email" trigger and here is where the magic happens.  (Not really. Feels like black magic.)

As you can see below, the two emails we are using "Test Email A" and "Test Email B" cannot be selected.

(We even created a couple more and voila, they appear in the list. Whichever emails are select back in step #1 do not show up as selectable emails in this step.)


PROBLEM: If we can't pick the emails and the action for the test, how can we set the link criteria?

The workaround that did not work...

We reset the A/B Test and started again.  This time, we skipped selecting the emails to be tested in step #1 above, and moved on to the custom conversion rules first.  This time they appear as expected and can be selected3.png

Then we select the link for the trigger.  No problem, all links contained in the emails appear.
(For this test sample, we are using Google as the external link.)


Next, we went back to step #1 to select to two emails, because we couldn't approve the program without selecting.  After doing that, everything looks as we would expect.


This does not "Play in Peoria."  We scheduled it to run, but nothing was sent.

Prepositional Clue … maybe?!

See in the Winner Criteria of the image above the phrase "Email is in (2) 'Test A/B..."  (hmmmm) 

Do these emails need to be in a separate program than the Email Send program?

Level 5

Re: How to setup whole email A/B test with custom conversion?

This issue is being caused because in order to select an email (that is used in an A/B test) in a trigger (any trigger not just the custom conversion trigger), the program (not just the email) must be approved first. Once the program is approved you should see the asset name change to ProgramName.TypeOfTest. You should be able to type that into the selected values box.

This is a very interesting chicken and egg scenario that you have stumbled upon. I would suggest contacting Marketo Support because it seems like this is something that needs to be addressed.

Level 4

Re: How to setup whole email A/B test with custom conversion?

We tried that and it still doesn't work. Ugh!