Andy_N
Level 1
Email Marketing Specialist
Contact Me
| Online Status |
Offline
|
| Date Last Visited |
Saturday
|
8
Posts
0
Likes
0
Solutions
a week ago
Can you give examples of "any service t hat uses a shared counter "?
Also, what do you mean by "a shared counter"?
... View more
a week ago
The concern with our previous experiments was the skews to our KPIs because different segments of our clients weren't represented equally in both groups.
What do you mean by webhook-powered services that can randomize on certain characteristics?
Can you give an example of a webhook that's used for strict round-robin distribution?
... View more
2 weeks ago
Hey everyone,
Working now with our data team on the best way for us to split the audience for the email A/B test campaigns. Until now we’ve been randomizing people for that purpose in our CRM using signup time and/or native A/B testing capabilities of Marketo when sending emails.
We’ve noticed though that it might be not ideal as some segments of our clients were overrepresented in one group vs another and this skewed success metrics since different segments are treated differently by sales. In general, different segments use our product differently so if they aren't represented roughly equally in A and B then we'll have an issue.
I there anyone here who has experience spliting their audiences into A and B themselves and how do you do that? Which formulas, algorithms do you use?
Any insights are appreciated.
Thank you!
Andy
... View more
12-15-2020
04:55 PM
I'm pretty sure I know what's the issue. One variation which had a gif went mostly to the promo/others tab..or maybe even the spam folder where the other went to the primary inbox that's why such a big gap in open rates though the subject and preview texts are the same.
... View more
12-14-2020
05:06 PM
Most actions affect one group of our users more than others. So when we run A/B tests we want to make sure that the 2 groups are roughly equivalent so the differences in their behavior can be attributed.
If you're asking which specific distribution (binomial, normal, t- distribution, Chi-Square, etc) we want... then unfortunately I don't have the answer to that.
Do you know which distribution is used by Marketo for A/B tests?
... View more
12-14-2020
04:35 PM
Knowing this how do you run A/B tests in Marketo to produce accurate results?
... View more
12-14-2020
03:38 PM
I've done an A/B test using the whole email variation test type with an audience of 3000 people. The A/B test was done on everyone (I’ve selected 100% thus I haven’t selected any winner criteria). So far 1 email got 45% more opens than the other (that’s about 60 people). I’m confused because the subject and preview text are the same… the low opens one even had slightly more delivered (10+ people) than the other one.
The audience for the test is big enough to make a statistically significant conclusion that the subject line or/and preview text in As is much better than in B however it’s not the case since both are the same.
Any idea why that would happen?
Which criteria does Marketo use to divide the audience into A and B?
How Marketo makes sure that audience A has the same attributes as the audience B?
I feel like Marketo didn’t divide the audiences “fairly”
My issue now is how can I rely on Marketo to run the A/B test for us?
... View more
07-22-2020
07:43 AM
We are currently cleaning our CRM and getting rid of many fields.
It would be very helpful if I could get a spreadsheet with all the fields that Marketo is currently using. Basically, I need a list that shows only fields that have something in “Field Used By” so we make sure not to touch those in our CRM.
I'm writing this here as I was told there is no feature or functionality available in Marketo to export only Used by fields and there is no workaround.
Thank you,
Andy Naumenko
... View more
- Find more ideas tagged with:
- field management
- field used by
- marketo fields
Public Statistics
| Date Registered | 01-21-2020 01:17 PM |
| Date Last Visited | Saturday |
| Total Messages Posted | 8 |
.png)