Email Program A/B Test Duration

Version 2

    Issue Description
    You want to know what the duration should be for an Email Batch Program's A/B Test.

     

    Issue Resolution
    When setting up an A/B Test in an Email Batch Program, the default, minimum duration of the test is 4 hours long.

     

    However, A/B tests should not usually be this short, for several reasons:

    • Depending on the size of the membership, and the background processes the Marketo System is engaged in, the Email Program may or may not even be able to send the complete test during the 4 hours.
    • 4 hours is a very short amount of time. Winner Criteria is only determined from the data gathered during the period of the test - that would be 4 hours. 4 hours may not be enough time.

     

    Ideally, A/B Tests should be "days" long, so that the test may complete and all appropriate information may be captured.