SOLVED

Re: How to stop pdf files hosted in Marketo being indexed?

Go to solution
SanfordWhiteman
Level 10 - Community Moderator

Re: How to stop pdf files hosted in Marketo being indexed?

Julz_James
Level 10 - Champion

Re: How to stop pdf files hosted in Marketo being indexed?

amazing..thank you!

Dan_Stevens_
Level 10 - Champion Alumni

Re: How to stop pdf files hosted in Marketo being indexed?

Learned something new once again - thanks Sandy!

Josh_Hill13
Level 10 - Champion Alumni

Re: How to stop pdf files hosted in Marketo being indexed?

Wow, of course.

How should the robots.txt be formatted to Disallow just pdf file types? Would this article help?

indexing - How to prevent a PDF file from being indexed by search engines? - Webmasters Stack Exchan...

apparently if you set the PDF headers correctly, you can make the PDF itself disallow crawling.

SanfordWhiteman
Level 10 - Community Moderator

Re: How to stop pdf files hosted in Marketo being indexed?

How should the robots.txt be formatted to Disallow just pdf file types? Would this article help?

I'd go with

User-agent: *

Disallow: /rs/

apparently if you set the PDF headers correctly, you can make the PDF itself disallow crawling.

Yep, that would be cool, but we don't have access at that level.