How to block search engine crawlers on a CDN pull zone
Search Engine Crawlers are a type of bot that is typically operated by search engines like Google and Bing to index the content of websites so that those websites can appear in search engine results.
If you wish to block search engine crawlers from indexing your CDN endpoints you can follow this simple guide.
Go to the Security tab in the Pull zone's manage page
Under Search Engine Crawlers tick the Block Search Engine Crawlers check box.
Click Save Crawler Settings
Your CDN endpoint will no longer be indexed and appear in search engine results.
If you wish to block search engine crawlers from indexing your CDN endpoints you can follow this simple guide.
Go to the Security tab in the Pull zone's manage page
Under Search Engine Crawlers tick the Block Search Engine Crawlers check box.
Click Save Crawler Settings
Your CDN endpoint will no longer be indexed and appear in search engine results.
Updated on: 03/14/2023
Thank you!