Sites are not crawled and indexed by Google

  • Resolved chrischtili

    (@chrischtili)


    2 years, 6 months ago

    My sites are not automatically crawled and indexed. I have to that manually in Google SearchConsole. Except for the main Page, here it is done automatically.
    Monitor says: The robots.txt file is not handled by The SEO Framework.

    Is it possibly related?

    The page I need help with: [log in to see the link]

Viewing 3 replies - 1 through 3 (of 3 total)
  • Thread Starter chrischtili

    (@chrischtili)

    solved. I will just wait another month.

    Plugin Author Sybre Waaijer

    (@cybr)

    Hi Chris,

    You asked me via email about the Monitor warning; this is not an issue, and you can safely ignore that message.

    Performing a site:https://example.com/ query of your site on Google, I can find all indexable pages of your website (and some marked with noindex recently, which still requires reprocessing).

    Could you please tell me where you read that your site isn’t automatically crawled or indexed? Google should periodically recrawl your pages without any instructions.

    If you have sitemap pinging enabled, your site will notify Google shortly after you publish changes. They’ll find the updated page(s) thanks to the sitemap’s lastmod field, which you have correctly enabled.

    Thread Starter chrischtili

    (@chrischtili)

    Hi Sybre,

    next week I will setup a new domain with the same content. I will start from Zero and install only the plugins, that are currently installed. No others.

    I am already curious whether TSF runs smoothly. I will use the same keywords and SEO tags as on the current one.

Viewing 3 replies - 1 through 3 (of 3 total)
  • The topic ‘Sites are not crawled and indexed by Google’ is closed to new replies.