Andy_N

Level 2

Joined the community 21-01-2020

Level 2

Email Marketing Specialist

Ottawa

Badges

Accepted Solutions

View leaderboards

Filter by user contributions

Re: Does anyone run A/B tests without relying on Marketo A/B test nati...

by Andy_N 01-13-2021

Can you give examples of "any service that uses a shared counter"? Also, what do you mean by "a shared counter"?

Discussions

2586 0 1
Re: Does anyone run A/B tests without relying on Marketo A/B test nati...

by Andy_N 01-12-2021

The concern with our previous experiments was the skews to our KPIs because different segments of our clients weren't represented equally in both groups. What do you mean by webhook-powered services that can randomize on certain characteristics? Can you give an example of a webhook that's used for s...

Discussions

2619 0 3
Does anyone run A/B tests without relying on Marketo A/B test native r...

by Andy_N 01-07-2021

Hey everyone, Working now with our data team on the best way for us to split the audience for the email A/B test campaigns. Until now we’ve been randomizing people for that purpose in our CRM using signup time and/or native A/B testing capabilities of Marketo when sending emails. We’ve noticed thou...

Discussions

2680 0 5
Re: Which criteria does Marketo use to divide the audience into A and ...

by Andy_N 12-15-2020

I'm pretty sure I know what's the issue. One variation which had a gif went mostly to the promo/others tab..or maybe even the spam folder where the other went to the primary inbox that's why such a big gap in open rates though the subject and preview texts are the same.

Discussions

3549 0 1
Re: Which criteria does Marketo use to divide the audience into A and ...

by Andy_N 12-14-2020

Most actions affect one group of our users more than others. So when we run A/B tests we want to make sure that the 2 groups are roughly equivalent so the differences in their behavior can be attributed. If you're asking which specific distribution (binomial, normal, t- distribution, Chi-Square, etc...

Discussions

3614 0 3
Re: Which criteria does Marketo use to divide the audience into A and ...

by Andy_N 12-14-2020

Knowing this how do you run A/B tests in Marketo to produce accurate results?

Discussions

3624 0 5
Which criteria does Marketo use to divide the audience into A and B?

by Andy_N 12-14-2020

I've done an A/B test using the whole email variation test type with an audience of 3000 people. The A/B test was done on everyone (I’ve selected 100% thus I haven’t selected any winner criteria). So far 1 email got 45% more opens than the other (that’s about 60 people). I’m confused because the su...

Discussions

3636 0 7
"Field Used By" Spreadsheet for Field Management

by Andy_N 07-22-2020

We are currently cleaning our CRM and getting rid of many fields. It would be very helpful if I could get a spreadsheet with all the fields that Marketo is currently using. Basically, I need a list that shows only fields that have something in “Field Used By” so we make sure not to touch those in o...

Ideas

905 0 0