Google Search Console “Crawled – currently not indexed”

  • Resolved DDS

    (@debdas)


    4 years, 10 months ago

    Hey, After Updating to v14 on 1st may, then I updated the lastest version 1 day later. I’m facing a lot of issues on the google search console.
    I found traffic went down on 3rd May(about 20% less). Then I doubted and found some of the top-ranking posts set to no-index on google search console. Then I manually checked another post, and some of them were indexed(i manually tried for index on google search console). Now I discover that on 2nd May my top performing 10 plus post in the excluded list on google search console.
    Since then my traffic went down by 60 to 80%(this is not because of google core update for sure)
    Now, All the posts and pages are showing “Indexed but not submitted in the sitemap” (resubmitted the sitemap), and some of them excluded as mention above. I don’t have any clue.

    Please Help! How do I index all of the posts and pages again?
    “Crawled – currently not indexed” is this permanent or temporary? don’t know what to do

Viewing 4 replies - 1 through 4 (of 4 total)

  • Hi @debdas,

    Sorry for the trouble this has caused.

    We would ensure that technically, our last major update v14.0 was basically in database optimization with an objective to make websites load faster. There was no change in the existing Yoast SEO analysis algorithm and the indexation logic of the plugin, therefore, we believe, update should not impact SEO ranking. However, we would love to investigate this.

    We know that Google Google Rankings (and the traffic it generates) depend on over 200 different factors. You can learn more about the 200 different factors that Google uses to determine ranking here: Algorithms. Other issues that determine rankings (and the traffic it creates) are the server load, page speed, cache configuration, mobile versions, responsiveness, the site’s content.

    And each year, Google changes its search algorithm around 500–600 times, and every change could have a site drop in ranking as consequences.

    Adding, recently they released the so-called May 2020 Core Update. You can learn more about that here.

    The “indexed but not submitted in sitemap” URLs are those that were found by Google through their crawling of the web, without having to find them in the sitemap. It’s possible that Google either indexed the URLs before they were added to the sitemap, that they found the URLs from third-party links, etc.

    It’s important to note that this is not an error or a warning. This is just a comment on their end, letting you know they found the URL through other means.

    Status shown “Crawled – currently not indexed” it is temporary. Those pages are in the queue so it’s going to take Google some time to get through them and mark them as either indexed or not. You may need to wait a couple of days or weeks to see the updated GSC report.

    I hope that helps and please let us know if other questions come up: we’ll be happy to assist you.

    • This reply was modified 4 years, 10 months ago by Suwash.
    Thread Starter DDS

    (@debdas)

    @suascat_wp Sir,

    The “indexed but not submitted in sitemap” URLs are those that were found by Google through their crawling of the web, without having to find them in the sitemap. It’s possible that Google either indexed the URLs before they were added to the sitemap, that they found the URLs from third-party links, etc.

    Before 2nd May all the links, posts, and pages were in the sitemap, after updating it somehow removes from the sitemap. I checked after 20$ traffic dropped on 2nd May, the next day 30%. So, I checked one of my 1st ranked posts and surprisingly the post was set to no-indexed itself. I did nothing. And All this happened after updating the plugin. Since then many top-ranking posts excluded from google search console, and that’s why my website traffic went down by 70 to 80%
    What’re your thoughts on this sir?

    Plugin Support devnihil

    (@devnihil)

    @debdas If you have pages/posts that should be included in the sitemap but are not, we would recommend first checking their settings to ensure that they aren’t being excluded. You can control what content types are included in the sitemap in the settings located in the SEO>Search Appearance area. To customize what types of pages or content are included in the sitemap you would need to perform the following steps:

      In WordPress, go to SEO>Search Appearance
      Click on the appropriate tab and make sure that ‘Show in search results? is set to ‘Yes’
      Setting this value to ‘Yes’ will make that content type or taxonomy be included in the sitemap and have it’s robots meta tag set to ‘index’.

    We also have additional information on configuring your XML Sitemap located at the following link: https://kb.yoast.com/kb/how-to-customize-the-sitemap-index/

    We would recommend checking to make sure the robots meta tag is NOT set to ‘noindex’ for on the individual page/post as well, as this setting can override the global default setting that is configured in SEO>Search Appearance. You can check this setting by performing the following actions:

      Go to the Edit screen for a page/post
      Scroll down to the Yoast Metabox
      Click on the ‘Advanced’ area
      For ‘Allow search engines to show this Page in search results?’ make sure this is set to ‘Yes’

    If you have confirmed that the page/post type has been set to be included in the sitemap and set to index and it is still not appearing in your sitemap, this could be caused if the site or server is caching the sitemap. We also have additional information on this at the following link: https://kb.yoast.com/kb/sitemap-does-not-update/. If you are not seeing the sitemap as updated, we would recommend checking your caching settings and to ensure that the sitemap is being excluded from the cache.

    If you are still experiencing an issue with the sitemap not updating after checking your caching settings, you can also force a cache reset by temporarily disabling the sitemap feature, and then re-enabling. To do so please perform the following steps:

      ?In WordPress go to SEO>General>Features
      ?For ‘XML Sitemaps’ Toggle the switch to ‘Disabled.’
      ??Click ‘Save Changes.’
      ?Toggle the switch back to ‘Enabled.’
      ?Click ‘Save Changes.’

    ?We also have a guide on how to enable/disable XML Sitemaps here: https://kb.yoast.com/kb/enable-xml-sitemaps-in-the-wordpress-seo-plugin/

    We are going ahead and marking this issue as resolved due to inactivity. If you require any further assistance please create a new issue. Thank you!

Viewing 4 replies - 1 through 4 (of 4 total)
  • The topic ‘Google Search Console “Crawled – currently not indexed”’ is closed to new replies.