Stop web crawlers scanning your WordPress site

To stop web crawlers and search engines from scanning your WordPress site edit your robots.txt file to contain the following… 

Disallow: /wp*
stop_web_crawlers_scanning_your_wordprpess_site.txt · Last modified: 2020/09/29 06:47 by bgfdsuperadmin
Except where otherwise noted, content on this wiki is licensed under the following license: CC Attribution-Noncommercial 4.0 International


  • Show pagesource
  • Backlinks
  • Recent Changes
  • Media Manager
  • Sitemap