Articles on: CDN Nexus

How to block search engine crawlers on a CDN pull zone

Search Engine Crawlers are a type of bot that is typically operated by search engines like Google and Bing to index the content of websites so that those websites can appear in search engine results.

If you wish to block search engine crawlers from indexing your CDN endpoints you can follow this simple guide.

Go to the Security tab in the Pull zone's manage page



Under Search Engine Crawlers tick the Block Search Engine Crawlers check box.

Click Save Crawler Settings



Your CDN endpoint will no longer be indexed and appear in search engine results.

Updated on: 03/14/2023

Was this article helpful?

Share your feedback

Cancel

Thank you!