Crawl-delay: 10

  • Resolved anniest

    (@anniest)


    7 years, 1 month ago

    I have a huge problem for some time, a bad plugin put me a virtual robots.txt;
    User-agent: *
    Crawl-delay: 10
    and I can not destroy this.

    I had put a physical robots.txt, but the result is nil because Google continues not to reference me.

    I just try your plugin, (another before) and nothing changes. I register your
    User-agent: *
    Disallow:

    but my files still indicate
    User-agent: *
    Crawl-delay: 10

    what can i do more ?

    tks
    https://www.artisanathai.com/

    • This topic was modified 7 years, 1 month ago by anniest.
Viewing 2 replies - 1 through 2 (of 2 total)
  • Thread Starter anniest

    (@anniest)

    i finish by put a real robots.txt

    but i am not sure of the result

    Plugin Contributor littlebizzy

    (@littlebizzy)

    You probably just needed to clear your caches. Our plugin doesn’t use the same database fields as others, so if you deleted your physical robots.txt and cleared your caches that should solve your issue.

Viewing 2 replies - 1 through 2 (of 2 total)
  • The topic ‘Crawl-delay: 10’ is closed to new replies.