Non-existent 'robots.txt' blocking category url's

  • Sitemap contains urls which are blocked by robots.txt specifically all Categories. What makes this interesting is that I have deleted the Robots.txt file and using the default WP robots.txt which is:
    User-agent: *
    Disallow: /wp-admin/
    So in effect, I don’t have this file, yet Google says it is being blocked. I even used the robots.txt tester to verify the above.

    Here is an example of one of the categories that Google says is being blocked.
    https://www.yourguidethroughcollege.com/category/academic-success/
    Even if I include;
    Allow: /category/
    it makes no difference.

    What do I need to do to resolve? Google hasn’t indexed, so for some reason something is broken. Ideas?
    Thanks.

    https://www.ads-software.com/plugins/wordpress-seo/

  • The topic ‘Non-existent 'robots.txt' blocking category url's’ is closed to new replies.