Failed: Robots.txt unreachable

  • Resolved galabina

    (@galabina)


    1 year, 5 months ago

    Dear Sirs,

    I am having issues with the indexing of my website. I inspected all the URLs in the Search Console, and it gave me the following message: Failed: Robots.txt unreachable – https://ibb.co/x8sMpfc

    In this case, I have set the recommended Robots.txt file from your plugin – https://myekmarketing.com/robots.txt. I also contacted Google support, but unfortunately, I haven’t received any response from them for three weeks. I also spoke to the hosting provider, and they told me that it’s not dependent on them. I don’t know what to do anymore.

    I would appreciate it if you could give me some advice and help me in this unpleasant situation.

    BR,

    Galabina

    • This topic was modified 1 year, 5 months ago by galabina.

    The page I need help with: [log in to see the link]

Viewing 1 replies (of 1 total)
  • Plugin Support Steve M

    (@wpsmort)

    Hi @galabina,

    I tested your robots.txt and it’s fine. I would recommend removing the rule shown below as it blocks Google from running CSS and JS so that they can render your pages:

    Disallow: /wp-content/themes/

    All in One SEO doesn’t generate the robots.txt, it’s WordPress that generates the robots.txt. All in One SEO just provides a convenient, easy-to-use method to add new rules to the default WordPress robots.txt.

    You can test your robots.txt in Google Search Console here – https://www.google.com/webmasters/tools/robots-testing-tool

Viewing 1 replies (of 1 total)
  • The topic ‘Failed: Robots.txt unreachable’ is closed to new replies.