error pages

Viewing 6 replies - 1 through 6 (of 6 total)
  • luisherranz

    (@luisherranz)

    Google sometimes crawls URLs that it finds inside script tags. In this case, those URLs are inside a script tag in your head.

    In my opinion, the easiest way to solve this problem would be to update your robots.txt to ensure that the wp-admin directory is disallowed and prevent search engines from crawling and indexing URLs under the wp-admin path.

    Something like this:

    User-agent: *
Disallow: /wp-admin/

    Let me know if that helps.

    Thread Starter 3r1ka

    (@3r1ka)

    Thanks for the reply.

    It seems that the robot.txt was already setup in this way, but I do still get the error

    User-agent: *

    Disallow: /wp-admin/

    Allow: /wp-admin/admin-ajax.php

    Sitemap: https://plemvisual.com/sitemap.xml

    Sitemap: https://plemvisual.com/sitemap.rss

    luisherranz

    (@luisherranz)

    Do you know why you have the Allow: /wp-admin/admin-ajax.php part? That’s probably causing the issue.

    Thread Starter 3r1ka

    (@3r1ka)

    No, It was like this by default. I am not even sure what could happen if I disallow. Do I try?

    luisherranz

    (@luisherranz)

    Yes, you can remove that line. Search engines should never crawl ajax URLs.

    Thread Starter 3r1ka

    (@3r1ka)

    I’ll try, thanks a lot for the help!

Viewing 6 replies - 1 through 6 (of 6 total)
  • The topic ‘error pages’ is closed to new replies.