LiteSpeed Cache Crawler – “No valid sitemap parsed for crawler” error

  • Resolved daniellacatus

    (@daniellacatus)


    1 week, 4 days ago

    Hello!

    I am experiencing an issue with LiteSpeed Cache Crawler not parsing my sitemap correctly. When I try to Refresh Crawler Map, I receive the error:
    “No valid sitemap parsed for crawler.”
    In addition, the Sitemap List displays a Sitemap Total: 0.

    Details of the Issue:

    • Report Number: AZFBJZFA
    • Date of Report: 11/10/2024 16:22:01
    • Problem Description: My sitemap structure is valid, with the tag present for each URL. However, the crawler is not parsing the sitemap as expected. I have tried disabling the Hide My WP security plugin, but the issue persists, suggesting this may not be the cause.<loc>

    Attempts to Resolve:

    • Adjusted rules to allow access to all sitemap files..htaccess
    • Verified the sitemap URL in LiteSpeed Cache > Crawler > Sitemap.
    • Checked related topics on the support forum but found no applicable solutions.

    Request: Could you please assist with diagnosing the root cause of this issue? Any specific guidance on how to configure the crawler to parse the sitemap correctly would be very helpful.

Viewing 6 replies - 16 through 21 (of 21 total)
  • Thread Starter daniellacatus

    (@daniellacatus)

    Yes.

    Plugin Support qtwrk

    (@qtwrk)

    I think it’s definitely something wrong on your server, like if they set connection timeout to 10 seconds or something , otherwise it should only times out after 60 seconds.

    you can ask them to check the test script I provided

    the script is using wordpress’s own function wp_remote_get to fetch sitemap , as a standalone test , no code from our plugin is involved.

    Thread Starter daniellacatus

    (@daniellacatus)

    Thank you for your previous help with the LiteSpeed Cache Crawler issues. After making adjustments, including disabling a security plugin, the crawler now partially functions. However, I’m still experiencing significant delays in site accessibility immediately after publishing or updating articles, updating plugins, or themes.

    The issue is particularly noticeable in SEO tools like Seobility, PageSpeed Insights, and GTmetrix, which frequently show “Page not accessible” errors for a few minutes post-update. Additionally, our social media distribution plugin posts content with substantial delays. The first page load after updates often takes between 40-60 seconds, which impacts the user experience, given our site’s frequent updates.

    Could you advise on potential LiteSpeed Cache settings, or any adjustments that might help resolve this ongoing issue with post-update accessibility and load times?

    Plugin Support litetim

    (@litetim)

    Yey!

    I would recommand looking into some development debug and then add changes to site. Is not normal for that big delay.
    From our part LSC will not add delay into publishing/saving a post.

    First thing I would do is make sure the cron is running on server side(not on admin). A page that will help you: https://runcloud.io/blog/external-cron-jobs-in-wordpress#how-to-set-up-serverside-wordpress-cron-events-in-cpanel I think your host have CPanel ??
    Second I would try to use as minimum plugins as necessary.

    I had a similar issue and it had to do with WordFence.

    Intially, I disable WordFence but the problem persisted.

    I had to complete remove WordFence from the database and htaccess files.

    After that the sitemap was accessible.

    Plugin Support litetim

    (@litetim)

    @senator94 thank you for your suggestion

Viewing 6 replies - 16 through 21 (of 21 total)
  • You must be logged in to reply to this topic.