Google crawling pages that don't exist

  • Google keeps generating crawl errors (404) for content that no longer exists and when I check where it’s being linked from, it says its coming from my website. My website is not that old and I don’t have that much content so I am 100% sure it has been removed.
    The only thing I can think of is it may have something to do with the Seo plugin since some of the “linked from” errors points to my website’s sitemap.

    Any help would be greatly appreciated.

    https://www.ads-software.com/extend/plugins/wordpress-seo/

Viewing 10 replies - 1 through 10 (of 10 total)

  • Can you post an example of the url that’s appearing that doesn’t exist?

    Thread Starter junior466

    (@junior466)

    It shows:

    URL not found
    https://mywebsite.com/2012/12/name-of-blog-post/

    Linked from:

    https://mywebsite.com/post-sitemap.xml
https://mywebsite.com/category/blog/
https://mywebsite.com/2012/12/name-of-blog-post/

    If you remove “category” and “2012/12/” from the links above those URLs do exist, but just not in way.

    Sounds like a permalink issue.Have you a set permalink set up within wordpress itself under settings-permalinks?

    Thread Starter junior466

    (@junior466)

    Yes. I have it set to “Post Name - https://mywesite.com/sampe-post/.”

    Under Yoast’s permalink settings I have a check on “Enforce a trailing slash on all category and tag URL’s” but don’t think that is the problem.

    Thread Starter junior466

    (@junior466)

    Sorry to revive an old thread but does anyone have a solution? Now I just found out that Webmaster Tools is reporting a crawl error at https://mywebsite.com/hello-world/ meaning it’s crawling the very first post that is default by WordPress that I have deleted a long time ago. It says it was detected on 06/06/2013. How could that be?

    I’ve started to see this in sites as well. Not sure if it’s Yoast SEO or hosting. Who are you hosting with?

    Thread Starter junior466

    (@junior466)

    I am hosting with A Small Orange.

    Thanks once again Dave for the taking the time to reply.

    I’m not familiar with them. However if you can look at your google webmasters and see if you also have a lot of 501’s it might be telling. If this is the case then I’d ask your host about the old url’s showing up as well as the 501’s.

    501’s are your hosting not yoast so you might be able to get them to have a look and see where all your errors are coming from.

    Thread Starter junior466

    (@junior466)

    I don’t have any 501’s in webmaster. Only two 404’s.
    I know, it’s really weird.

    Hello,
    I have the same issue. Having 404 errors |(over 500) for un-exacting uls and lot of tags.
    It started after upgrading my site, and urls just disappeared. Checking with webmaster tools for the “linked from” there is a big list. But clicking on each link – some do not exist and going to error page and other just go to unrelated pages.
    Big mess that I don’t know how to fix.

    Appreciate any help

Viewing 10 replies - 1 through 10 (of 10 total)
  • The topic ‘Google crawling pages that don't exist’ is closed to new replies.

Tags