Engagement Programs - A/B Testing

[Andrea_Lechner]

How is the best way to incorporate A/B email testing within the Engagement Module?

The best solution I can figure out is to direct that email to a program's smart campaign and let the smart campaign do the 50/50 email split testing.

Am I missing a better way?  Thx, Andrea

[Anonymous]

I believe this information is well out of date and this discussion should redirect people to read - https://nation.marketo.com/message/117630#comment-117630 

[Anonymous]

Do you have the campaign in a program? It has to be in a program to be added to the stream, and only one per program. So if you need to make 9 different campaigns to do A/B testing on 18 different emails, you need to make 9 different programs.

Also, check and make sure that the smart campaign criteria (smart list) is something that will pull the leads in (ex: member of engagement program: prospects, stream: early).

Then be sure and activate the program in the stream.

Hope this helps!

[Anonymous]

Ok so I scheduled the AB test campaign to run once (because I have no clue how to properly set it so that I can add it to an engagement stream).

That did not work--I still cannot add it to the engagement stream.

Then I cloned the campaign and set it up to run a recurrent schedule of 'daily'--that did not work either--I cannot add it to the stream.

Can someone please tell me what I'm doing wrong here? I cannot find any clear documentation. My first email in a series of 9 that I'm trying to build this stream for is my AB test. If I can't get the first one in there, then I can't get the remaining 8, and I still have to test to see if this even works!! HELP!!

[Anonymous]

I've created a smart campaign as you described above and have a flow step to split test an email. 

How am I supposed to add this to the stream? I tried to drag it and add it through choosing the program but can do neither. I don't understand how to do this?
--do I schedule the campaign and then add it? If so, what schedule to do I set it to if I want it to run on the stream cadence I've set for the engagement program?
--do I activate all of the content on the stream in order to activate the program so that the unscheduled smart campaign will appear as a choice?
--does my smart campaign have to have a trigger instead of a filter in the smart list criteria? If so, what trigger should I use?

Thanks for your help.

[Anonymous]

Is there a way to test A/B programs with the "Test Stream" functionality?  It runs though emails just fine, but when it hits a program's A/B smart campaign I get the following in the results tab: 'Do Nothing' was set for this choice, 1 leads skipped. 

[Anonymous]

You cannot pull 2 campaigns from the same program into a stream.  To do the AB Test, you would need to use a single campaign, with random sample in Add Choice.

[Anonymous]

It looks like if you try to use two smart campaigns from the same program, it rejects it and says it's duplicate. Do we need a program for each smart campaign to go into the stream?

[Anonymous]

Hi Emily, I just drag the campaign over from the left-hand tree and, VOILA!  Everything is done from there... you'll see the program in the stream.  So, just activate and you're good.

[Anonymous]

What's the best way to reference the program name within the stream since the A/B testing smart camaign isn't activated? 

[Anonymous]

Yes, and this program is referenced on the stream.  

[Anonymous]

So to do A/B testing in the engagement program streams you have to do it through smart campaigns? 

Would it be: Smart List - Member of Engagement Program
                      Flow - (email choices with random samples)
And then do you just not schedule it?

Thanks!

[Anonymous · Accepted solution]

That is exactly how you will do it!