Email Program A/B Test Duration

A document by on behalf of Miles Ybaben on Jun 13, 2017Last modified by Michelle Malkasian on Jun 13, 2017
Version 2Show Document
  • View in full screen mode

Issue Description
You want to know what the duration should be for an Email Batch Program's A/B Test.


Issue Resolution
When setting up an A/B Test in an Email Batch Program, the default, minimum duration of the test is 4 hours long.


However, A/B tests should not usually be this short, for several reasons:

  • Depending on the size of the membership, and the background processes the Marketo System is engaged in, the Email Program may or may not even be able to send the complete test during the 4 hours.
  • 4 hours is a very short amount of time. Winner Criteria is only determined from the data gathered during the period of the test - that would be 4 hours. 4 hours may not be enough time.


Ideally, A/B Tests should be "days" long, so that the test may complete and all appropriate information may be captured.