Champion/Challenger Capability in Batch Campaigns

Champion/Challenger Capability in Batch Campaigns

It was recently confirmed to me by support that Champion/Challenger tests can only be used with trigger campaigns. While I understand that there are other A/B test capabilities, Champion/Challenger tests are very easy to set up and execute, and lead to more efficient testing across the board.

The fact that they can only be used with trigger campaigns unearthed another limitation for those of us using programs in engagement programs... You cannot do Champion/Challenger tests here either, because they are batch campaigns.

There was recently a bug that was allowing these tests in batch campaigns, so hopefully it wouldn't be too hard to implement this, and it would make testing much easier all-around!!
34 Comments
Sam_Chou1
Level 2
Hi Abdallah - They would all be in the "first cast." The trigger campaign immediately follows the EP's batch campaign.

 
Anonymous
Not applicable
Sam, but you have two programs - so how do you get them both in the first cast?
Sam_Chou1
Level 2
Send me an email at sam.chou@clarizen.com and I'll walk you through it.
Anonymous
Not applicable
Thanks! Will do now.
Anonymous
Not applicable
Sam, thanks for this.  I'm going to try it and email you if I need help as well.  I do hope Marketo fixes this soon though - manual work arounds defeat the purpose!
Sam_Chou1
Level 2
Slight hiccup to this workaround - I don't think Marketo's trigger campaigns are built to handle the tens of thousands of leads that get triggered during an engagement program cast. My last cast completely paralyzed my system for 6 hours as Marketo tried to work through the email sends, and then since the email campaigns take priority, all other triggered campaigns could not fire.

I'm a little torn here b/c I still want to use programs + smart campaigns for my engagement program casts, but I don't want to lose the ability to do a/b testing. I think my best course of action right now is to just trigger these email sends during off-hours so I don't impact day-to-day operations. 😞
Anonymous
Not applicable
Cherly, would love you to jump in.

Sam thanks for the work around but I'm with Chantelle....too manual for something that should be automated.

To confirm funtionality, will this work.....
  • Inside an engagement program?
  • Outside an engagement program?
Need an exclusion campaign to block some people from receiving the email who received content elsewhere.

0EM50000000SzyI.jpg


 
David_Desrosie2
Level 4

Joining the club...Any update on this?

Jamie-Carey
Level 6

Frustrated with having to do workarounds after discovering something doesn't work as expected. This conversation is THREE years old and it's still not documented. So instead of using a backend batch program we have to add in trigger programs to our nurture which is a potential liability.

Dory_Viscoglio
Level 10

Jamie, Marketo has actually done a better job of identifying this in the documentation (Add an Email Champion/Challenger - Marketo Docs - Product Docs )

pastedImage_1.png