Hi, Kelley Sandoval and I are considering converting all the emails in our nurture streams to nested programs housing smart campaigns. One of the reasons we're considering this is to improve our A/B test reporting, as we found that using the traditional Champion/Challenger test for our nurture emails resulted in the following issue: When we ran separate one-off email blasts that referenced these nurture emails, our A/B test results for those nurture emails were inflated on one side (since the email was referenced in the blast, but only one version of the email actually ran since Champion/Challenger does not work for batch campaigns, making it appear as though that version got more opens and clicks). We found a workaround by creating 2 separate reports that look at each test version, excluding the email blast campaign, but this is not scalable. Keeping that in mind, what is the best way to set up programs within nurture streams to ensure that our A/B testing reporting is efficient and we are also excluding anyone who has already received the email via one of our blasts (which are separate batch campaigns). At first, we considered putting a "was sent email" exclusion in the program smart list, but Marketo documentation states the following: "If the engagement program calls a smart campaign within a program, people who don't meet the smart list criteria won't receive the email. They also won't move on to the next program in the current cast or in subsequent casts. Essentially they'll be stuck in an infinite loop, where they never qualify. You may want to use choices on flow steps to filter people out instead of adding these criteria to smart lists when you nest programs inside of an engagement program." We want to ensure that individuals who later become members of our nurture programs do not receive the same email they received in a prior blast outside the nurture. At the same time, we also want to make sure they are able to progress to subsequent programs within the nurture stream. Any ideas on how to best do this?
... View more