Re: No reCaptcha No Honeypot:Identify Spam, Invalid, and Junk Emails in Marketo

Ajay_Mamgain2
Level 3

No reCaptcha No Honeypot:Identify Spam, Invalid, and Junk Emails in Marketo

Business Issue: Marketo lead database is full of invalid, disposable Emails (Spam Domain), junk Email address find a solution to identify such leads, and reduce the lead database load.

 

Solution: Create a custom webhook to verify the domain and valid syntax of an Email. Most of the suggestions which you see in the Marketo community are related to "Honeypot" as a hidden field. However, this solution doesn't work at all because of the simple fact you can train your bot to ignore the hidden field. You can also test it out with simple chrome extension "Form Filler" under field options you will find ignore all hidden fields.

form-filler.png

In order to identify spam(disposable), invalid, and junk emails. I ended up developing a webhook which does the following steps :

  • lower Email addresses (formatting)
  • Valid Email Syntax
  • Domain check with up to 5k disposable Email list (Spam domain)
  • ping for MX record (mailbox exchange) 
  • Blacklist Domains 
  • Custom LIst

For eg:

Lower Email address and Valid Email syntax check.

example1.png

You will find an Email address is in all capital and the Email address is missing ".com" And, Marketo lets you submit the form.

 

 

 

 

 

 

 

Now Let's look at the response from the spam identifier.

Example-Answer-Spam.jpgLook at the response Email lowercase and validEmail is "Bad Syntax" other responses spam_note and mxRecord are left untouched

 

 

 

 

 

 

 

Example 2: Spam domain

example2.jpg

We used a popular spambot domain "mailinator.net". The application then looks at the list of 5k disposable email domains and assigns a similarity score of 95 along with a similar domain for further check.  You can even find mxRecord linked with the domain.

 

Example 3: Junk Domain

 

example3.jpg

In the above example, I have randomly typed the email address which is a perfect example of the junk entries we get on a daily basis. mxRecord comes to rescue in this case as you found no "spam_note" and email is using valid syntax.

 

A combination of the above validation and custom logic provides the best solution in Marketo to identify junk and unmarketable leads and keeps your database intact. Almost, all the solutions in the market work on these principles, and the only exception is that I'm not sending an email to check the deliverability status code because it might end my domain in the blacklist.

 

 

2 REPLIES 2
SanfordWhiteman
Level 10 - Community Moderator

Re: No reCaptcha No Honeypot:Identify Spam, Invalid, and Junk Emails in Marketo

Interesting way of simulating true SMTP validation, Ajay.

 

But you're making a false equivalency here:  reCAPTCHA has never been intended to detect non-emailable leads! Detecting non-human activity (automated form submissions) and detecting non-emailable leads (nonexistent local-parts and/or domains) are orthogonal concerns, each with their own solutions.

Ajay_Mamgain2
Level 3

Re: No reCaptcha No Honeypot:Identify Spam, Invalid, and Junk Emails in Marketo

Thanks for your comments @SanfordWhiteman