In a smart campaign flow step, we are doing some testing and it raised a question as to how Random function works in choice steps. I've laid out two potential RANDOM methodologies and 2 potential scenarios. I'm trying to figure out which is the correct methodology that Marketo uses.
Method A: Each subsequent random step pulls that percentage from the starting pool of leads;
Method B: Each subsequent random step pulls that percentage from the remaining leads;
Scenario 1 is to send 4 versions of an email equally split between each group 25% each to 1000 qualifying leads.
Scenario 1 Method A:
Send Email Step
Scenario 1 Method B:
Send Email Step
Scenario 2 is to send a Chinese and Japanese email to those with that language preference, then do a 50/50 test with the remaining, still a total of 1000 qualifying.
Scenario 2 Method A:
Send Email Step
Scenario 2 Method B:
Send Email Step
Interesting question you raise. It is method A, according to the testing that I've done thus far, which was more along the lines of the setup in your scenario 1. I haven't explicitly tested mixing various fields in the choices, but that would be fairly easy to test to confirm that it works the same.
Agree, you should test it.
I suspect B will not work right.