A/B Test where half the audience gets email and half gets nothing

piperbrowne
Level 1

Hello! Does anyone have suggestions on the best way to create an A/B test for a blast email where half the audience receives an email and half receives nothing? Thanks!

2 REPLIES 2
Darshil_Shah1
Level 10 - Community Advisor + Adobe Champion

If you’re using the OOTB A/B test available in the email program, then you need to set the test sample size in the A/B test settings to determine the sample size for the qualified people to receive the test emails and the winner email. If you don’t want a portion of people to receive emails from this blast then why not filter them out in the smart list itself? 

 

Do you have any specific use-case/need where in you’re not able to suppress the people you don’t want to send any (test/winner) emails qualify for the send? Let’s back-track a bit to understand and analyze the use-case so as to potentially avoid an XY problem here. 

 

jace_brendle
Level 3

I'm curious what the use case for this is, so if you can expand on that I'd appreciate it.

However, you can do this via a smart campaign instead of an email program. If you create a smart campaign with your full list in the smart list, then add a flow step to send the email with a choice to select a random sample of 50% to get the email and the rest "do nothing"

jace_brendle_0-1673376193465.png

you'll need to pull an email performance report to make any decisions.