10WEB Boost + Robots.txt error

  • Resolved bdbconcierge

    (@bdbconcierge)


    1 year, 5 months ago

    I have a problem or I’m not entirely sure whether it is or can become a problem. I have my site crawled by ahref every day for the site audit. Everything was fine until I noticed 2 new notices or problems since October 7th. I have activated the 10web booster plugin, but the free version without cdn cloudflare only has a page popped up in the crawling which is called: e-mail protection I cloudflare. That’s not my problem, but the ahref shows me that my robots.txt is not accessible. the http status code is timeout and robots.txt error says internal error. I don’t know how to fix this or where it comes from.

    If you need more information, please ask.

    • This topic was modified 1 year, 5 months ago by bdbconcierge.
Viewing 1 replies (of 1 total)
  • Plugin Support Mane Grigoryan

    (@manegr)

    Hi @bdbconcierge ,
    Thank you for contacting us.

    10Web Booster should not have any impact on your robots.txt file. Will you please kindly enable 10Web Booster Test Mode and check if the issue is still present?

    I would appreciate it if you would follow these steps and let me know if they help.?
    Regards, Mane

Viewing 1 replies (of 1 total)
  • The topic ‘10WEB Boost + Robots.txt error’ is closed to new replies.