Engagement Score: Program Success

Lauren_Galietti
Level 3

Engagement Score: Program Success

I just read the article "Understanding the Engagement Score" (http://community.marketo.com/MarketoArticle?id=kA050000000LAQLCA4) and have a question. It says the score takes into account opens, clicks, program success, and unsubscribes.
 

How is program success for an engagement program defined?

Tags (1)
6 REPLIES 6
Anonymous
Not applicable

Re: Engagement Score: Program Success

If you use a program in the stream instead of an email, the engagement score is calculated on the program success only.  If you use an email, it looks at the email metrics as described in the article.
Ari_Echt1
Level 5

Re: Engagement Score: Program Success

Hi Cheryl,

What if the programs we use in the stream are operational programs, and do not have program success?

What would engagement score mean?

Kenny_Elkington
Marketo Employee

Re: Engagement Score: Program Success

If there aren't any program successes against the sample size, then engagement score isn't meaningful.

Josh_Hill13
Level 10 - Champion Alumni

Re: Engagement Score: Program Success

So I'm curious if I create a custom Engagement Nurture channel with my own Statuses and Success, how will that affect the engagement score?

I'd assume it would not, but the system would no longer automatically set a lead to "Success"...right? I would have to do that manually somehow.
Anonymous
Not applicable

Re: Engagement Score: Program Success

Hi Cheryl, hope you can answer this related question -- to clarify, Program Success is only based on the member statuses that are shown as "Success"?  In our case, we have a number of statuses but "Responded" is Success.  Although I still don't understand how our Engagement Score is calculated because in one email program where there is only 1 response out of ~300, it has an Engagement Score of 90.  
Dan_Stevens_
Level 10 - Champion Alumni

Re: Engagement Score: Program Success

We were facing the same dilemma.  We usually use Programs, not Emails, within our EPs.  When looking at the Engagement Stream Performance Report, every email had a score of 90, regardless of the responses (on average, our CTR is 4%).  What's happening is Marketo is basing this score on the success within each program AS A PERCENTAGE OF INDIVIDUAL PROGRAM MEMBERSHIP (not EP membership).  That's the key here.  Even though you might have 300 members of an engagement program, Marketo is looking at program-level membership.  So if you were like us, only those success statuses were being calculated in each program (there were no other types of members). 

What you need to do is to define program membership for activity prior to success, e.g., "Delivered Email" (which is a program status we use and apply to all leads where an email has been delivered (we give this 24 hours to work)).  With this approach, Marketo can then more accurately create an engagement score/ratio by dividing program success by total program members (again, not to be confused with EP members). 

I think this would be a lot less confusing if Marketo would just base the score off of EP membership, and not indiviudal program membership. 

BTW, I also learned from Support that "we only include leads in the Engagement Score who were members of the program or reached success during last 3 nurture cast (this is an internal calculation limitation)."