[Plugin: WordPress SEO by Yoast] Robots.txt

Viewing 1 replies (of 1 total)

  • robots.txt isn’t required BUT it is recommended.

    I have a default one that I use on all my WordPress installations, shared below.

    robots.txt

    User-agent: *
Disallow: /cgi-bin/
Disallow: */wp-*
Disallow: *.php
Disallow: */feed*
Disallow: */trackback*
Allow: */wp-content/uploads*

Sitemap: https://yourdomain.com/sitemap_index.xml

Viewing 1 replies (of 1 total)
  • The topic ‘[Plugin: WordPress SEO by Yoast] Robots.txt’ is closed to new replies.