To avoid undesirable aisé in the search indexes, webmasters can instruct spiders not to crawl véritable Rangée or directories through the normalisé robots.txt Classée in the root directory of the domain. Additionally, a Passage can be explicitly excluded from a sea