AnsweredAssumed Answered

Whitelisting Crawl Tools without removing robots.txt?

Question asked by f5eb2814290e0f24d46d398f8e0f674170b4529d on Nov 28, 2017
Latest reply on Nov 28, 2017 by Sanford Whiteman

Hi there,

 

We use a tool called SiteImprove for our main site, and want to add our Marketo landing pages for improvements. But since our pages are non-crawlable to search engines, the tool doesn't recognize them as a verified group of pages.

 

Has anyone been able to whitelist certain crawling tools for Marketo landing pages?

Outcomes