• The WordPress virtual robots.txt seems to be overriding my custom robots.txt.

    As you can see at: My Robots File the default robots.txt is showing, even though I have uploaded a custom robots.txt file.

    How can I prevent WordPress from overriding my custom robots.txt file?

Viewing 2 replies - 1 through 2 (of 2 total)
  • Moderator Steven Stern (sterndata)

    (@sterndata)

    Volunteer Forum Moderator

    I see this… it doesn’t look like the WP default robots.txt file:

    Sitemap: https://joshuarosato.ml/sitemap_index.xml
    
    User-agent: *
    Disallow: /wp-admin/
    Disallow: /?s=
    Disallow: /search/
    Disallow: /cgi-bin
    Disallow: /wp-includes
    Disallow: /wp-content/plugins/
    Disallow: /wp-content/cache/
    Disallow: /wp-content/themes/
    Disallow: */trackback/
    Disallow: */feed/
    Disallow: /*/feed/rss/$
    Disallow: /category/*
    Allow: /wp-admin/admin-ajax.php
    Thread Starter joshuarosato

    (@joshuarosato)

    Yes, that’s the custom file, but Google and I are still seeing the default.

    For clarification, I’ve tried both logged in and out on 3 different web browsers.

    EDIT: It shows up properly on my phone, but Google still sees the default.

    • This reply was modified 7 years, 9 months ago by joshuarosato.
    • This reply was modified 7 years, 9 months ago by joshuarosato.
Viewing 2 replies - 1 through 2 (of 2 total)
  • The topic ‘WordPress Virtual Robots.TXT Overriding Custom Robots.TXT’ is closed to new replies.