Viewing 1 replies (of 1 total)
  • WordPress uses a ‘virtual’ robots.txt. When you add your own robots.txt file, WordPress will not output the ‘virtual’ robots.txt file.

    ALso, you want to submit both the robots.txt file and the sitemap_index.xml that is also a virtual file created by WP SEO in this case. This index lists your sitemaps based on your SEO preferences. It is all you need to share with Google for your sitemaps.

    Also, once you re-submit, give Google and day or so…to re-check your site. It will not just keep doing so, but does so on it’s schedule.

    Also note that robots.txt files do not force bots to not fetch and not list your site(s). Good Search engines tend to obey them, the others not so much. So the majority of your robots.txt file is not useful. Just use the virtual one (remove your file from the root of site), submit the sitemap index, and wait…

Viewing 1 replies (of 1 total)
  • The topic ‘Webmaster showing me errors’ is closed to new replies.