Champion/Challenger Capability in Batch Campaigns

[Dory_Viscoglio]

It was recently confirmed to me by support that Champion/Challenger tests can only be used with trigger campaigns. While I understand that there are other A/B test capabilities, Champion/Challenger tests are very easy to set up and execute, and lead to more efficient testing across the board.

The fact that they can only be used with trigger campaigns unearthed another limitation for those of us using programs in engagement programs... You cannot do Champion/Challenger tests here either, because they are batch campaigns.

There was recently a bug that was allowing these tests in batch campaigns, so hopefully it wouldn't be too hard to implement this, and it would make testing much easier all-around!!

[Sam_Chou1]

Hi Abdallah - They would all be in the "first cast." The trigger campaign immediately follows the EP's batch campaign.

 

[Anonymous]

Sam, but you have two programs - so how do you get them both in the first cast?

[Sam_Chou1]

Send me an email at sam.chou@clarizen.com and I'll walk you through it.

[Anonymous]

Thanks! Will do now.

[Anonymous]

Sam, thanks for this.  I'm going to try it and email you if I need help as well.  I do hope Marketo fixes this soon though - manual work arounds defeat the purpose!

[Sam_Chou1]

Slight hiccup to this workaround - I don't think Marketo's trigger campaigns are built to handle the tens of thousands of leads that get triggered during an engagement program cast. My last cast completely paralyzed my system for 6 hours as Marketo tried to work through the email sends, and then since the email campaigns take priority, all other triggered campaigns could not fire.

I'm a little torn here b/c I still want to use programs + smart campaigns for my engagement program casts, but I don't want to lose the ability to do a/b testing. I think my best course of action right now is to just trigger these email sends during off-hours so I don't impact day-to-day operations. 😞

[Anonymous]

Cherly, would love you to jump in.

Sam thanks for the work around but I'm with Chantelle....too manual for something that should be automated.

To confirm funtionality, will this work.....

• Inside an engagement program?
• Outside an engagement program?

Need an exclusion campaign to block some people from receiving the email who received content elsewhere.



 

[David_Desrosie2]

Joining the club...Any update on this?

[Jamie-Carey]

Frustrated with having to do workarounds after discovering something doesn't work as expected. This conversation is THREE years old and it's still not documented. So instead of using a backend batch program we have to add in trigger programs to our nurture which is a potential liability.

[Dory_Viscoglio]

Jamie, Marketo has actually done a better job of identifying this in the documentation (Add an Email Champion/Challenger - Marketo Docs - Product Docs )