A/B testing on dynamically generated emails.

[Anonymous]

Hello,

Anyone know if its possible to automatically integrate A/B testing on dynamically generated emails? And if it is, how do we set it up?

Thanks in advance!

[Justin_Norris1]

Genevieve George​, how are your emails being dynamically generated? How/when are they sent? What do you want to test?

I think that context will help the community offer suggestions.

[Josh_Hill13]

You may find Champion/Challenger testing helpful.

Keep in mind if you use Dynamic Content, this will create a huge number of variations while the test itself will be limited to Subject Line or Whole Email.

[Anonymous]

Thanks Justin Norris We are using rest API to generate daily newsletters. We just want to test the subject lines. We can't figure out how to do this.

[Justin_Norris1]

Genevieve George​

Interesting one.

So I'm assuming you have an email going out on a daily campaign (batch or trigger?) with the content generated by the API.

If it is a daily triggered campaign triggered by API, you could use Josh Hill​ 's suggestion of Champion challenger and have have a single campaign. Either use Champion challenger to test the subject lines or use it to do a whole email test and populate two emails with two different subject lines via API.

The champion challenger would take care of splitting the traffic and providing some measurement.

Alternatively, simply set up two separate smart campaigns with two different emails. You would need to take care of splitting the traffic between the two campaigns. Dynamically populate the two emails with your variations. Then you can line them up in an email performance report and compare performance on the two emails.