Re: A/B Test where half the audience gets email and half gets nothing

piperbrowne
Level 1

A/B Test where half the audience gets email and half gets nothing

Hello! Does anyone have suggestions on the best way to create an A/B test for a blast email where half the audience receives an email and half receives nothing? Thanks!

2 REPLIES 2
jace_brendle
Level 3

Re: A/B Test where half the audience gets email and half gets nothing

I'm curious what the use case for this is, so if you can expand on that I'd appreciate it.

However, you can do this via a smart campaign instead of an email program. If you create a smart campaign with your full list in the smart list, then add a flow step to send the email with a choice to select a random sample of 50% to get the email and the rest "do nothing"

jace_brendle_0-1673376193465.png

you'll need to pull an email performance report to make any decisions.

 

Darshil_Shah1
Level 10 - Community Advisor + Adobe Champion

Re: A/B Test where half the audience gets email and half gets nothing

If you’re using the OOTB A/B test available in the email program, then you need to set the test sample size in the A/B test settings to determine the sample size for the qualified people to receive the test emails and the winner email. If you don’t want a portion of people to receive emails from this blast then why not filter them out in the smart list itself? 

 

Do you have any specific use-case/need where in you’re not able to suppress the people you don’t want to send any (test/winner) emails qualify for the send? Let’s back-track a bit to understand and analyze the use-case so as to potentially avoid an XY problem here.