Disallow files in Design Studio to be crawled

[Jean-Pascal_Mer]

Hi folks,

I'm looking for a way to disallow files uploaded in the Design Studio to be crawled.

We have an area of our website we are hiding from search engines, but because these pages link to PDF hosted in the Design Studio, robots still crawl the pages and result in some organic traffic hitting the pages.

Anyone know of a way to do this and keep the files in the design studio v. switching files to an in-house server.

Thanks

[Anonymous]

Hey Jean-Pascal Mercier​, I believe you set your LPs to "no index/no follow" , that should do it. Referring to this post: "No Follow" on Landing Pages?

[Edward_Unthank_ · Accepted solution]

Hey Jean-Pascal, you can call up Marketo Support and work with them to change your robots.txt file to disallow the Design Studio files (site folder, really) to be archived.

Cheers

Edward

[Jean-Pascal_Mer]

Magical!

Thanks!!

[Geoff_Krajeski1]

Edward Unthank is correct.  We just did this ourselves!

Open a support case with Marketo

[Jamie-Carey]

I'm actually shocked to find out this is the default that those files are indexed. For a business that is built on gated content for leads, this is a HUGE oversight.