Ability to "noindex" documents in the Images and Files folder.

Ability to "noindex" documents in the Images and Files folder.

Some of our gated PDFs in the Images and Files folder are being found by search engines. We need the ability to prevent PDF files hosted by Marketo from being indexed by the search engines.  Perhaps the ability to specify a portion of the robots.txt file for just our files that Marketo hosts?

Of course we could host these on our own server and update our own robots.txt file to exclude these from the search engines, but it lessens the value of having Marketo as a single CDN for our content.
2 Comments
Anonymous
Not applicable
Hello Elliot,

This is a great idea to impliment a robots.txt on the domain server for the design studio elements.  Or updating the .htaccess file.  But in the interim I might suggest putting the rel="nofollow" on the links to the pdf files.

Example:
<a href="http://somewhere.pdf" rel="nofollow">Download PDF</a>

This will prevent web crawlers from indexing the pdf when they inspect the landing page elements.

I hope this helps.

kh-lschutte
Community Manager
Status changed to: Open Ideas