Crawler stopped working automatically

  • Resolved Argument

    (@argument)


    1 year, 9 months ago

    I noticed that the crawler wasn’t working properly.
    First site. Report: PVXJJZZJ
    Started crawler manually. Showed all pages with “Hit” status (green indicator). After that, an hour later, the site map was rebuilt. But now status “Wait” (gray indicator), although the cache was not reset, and new pages were not added.

    The second site. Report: XRFUSLCA
    All the same settings. But after an automatic crawler override site map is deleted, that is, the site map becomes empty, and all the color crawler indicators with the sign –. The problem is solved by starting crawler manually. Then it finds the sitemap and displays pages with “Hit” status (green indicator).

    • This topic was modified 1 year, 9 months ago by Argument.
Viewing 4 replies - 1 through 4 (of 4 total)
  • Plugin Support qtwrk

    (@qtwrk)

    the new status (the grey/wait part) will only reset after all crawler tasks are finished

    Thread Starter Argument

    (@argument)

    @qtwrk

    I didn’t quite understand the answer. It never happened before. If the crawler runs on a schedule and updates the map every hour, and the cache was not deleted, then I saw all the pages in the Hit section. Now, on one site the crawler deletes the site map and all pages from the index, and on the other site all pages are displayed in the “Wait” section. Is this normal?

    Plugin Support qtwrk

    (@qtwrk)

    if you manually refresh the sitemap , does it give you any error message ? or just successfully refreshes it ?

    does this always happen ?

    • This reply was modified 1 year, 9 months ago by qtwrk.
    Thread Starter Argument

    (@argument)

    @qtwrk

    The sitemap is only deleted on 1 site if the crawler runs automatically. If I run the crawler manually, it will rebuild the map, no errors will be displayed. If I click the “Manual Run” button several times, all pages of the sitemap will be scanned with the status “Hit”. However, after the crawler automatically scanning the sitemap, the sitemap will be deleted automatically.

    • This reply was modified 1 year, 9 months ago by Argument.
Viewing 4 replies - 1 through 4 (of 4 total)
  • The topic ‘Crawler stopped working automatically’ is closed to new replies.