Stuck at Start watching…

please provide the report number , you can get it in toolbox -> report -> click “send to LiteSpeed”

and also please do me a full screenshot on your crawler summary page.

Report Number: HVBZTNLW

Summary page: https://ibb.co/RvKQ7d6

please go to Map tab , refresh the sitemap

I’ve already refresh it and then manually run crawler, but still nothing change.

<?php

require( './wp-load.php' );
$args = array(
  'timeout'   => 100,
  'blocking'  => true,
  'sslverify' => false,
  // 'cookies'   => $_COOKIE,
);

$url = 'https://domain.com/wp-admin/admin-ajax.php?action=async_litespeed&nonce=123123123&litespeed_type=crawler_force';
$result = wp_remote_post(esc_url_raw($url), $args);

var_dump($result);

please create a php file with above code , place it at same dir as your wp-config.php , replace the https://domain.com/ to your actual , then open it in browser, see what it returns.

array(6) { ["headers"]=> object(WpOrg\Requests\Utility\CaseInsensitiveDictionary)#19721 (1) { ["data":protected]=> array(10) { ["server"]=> string(9) "openresty" ["date"]=> string(29) "Tue, 05 Mar 2024 07:26:32 GMT" ["content-type"]=> string(24) "text/html; charset=UTF-8" ["content-length"]=> string(1) "1" ["x-robots-tag"]=> string(7) "noindex" ["x-content-type-options"]=> string(7) "nosniff" ["expires"]=> string(29) "Wed, 11 Jan 1984 05:00:00 GMT" ["cache-control"]=> string(36) "no-cache, must-revalidate, max-age=0" ["referrer-policy"]=> string(31) "strict-origin-when-cross-origin" ["x-frame-options"]=> string(10) "SAMEORIGIN" } } ["body"]=> string(0) "" ["response"]=> array(2) { ["code"]=> int(400) ["message"]=> string(11) "Bad Request" } ["cookies"]=> array(0) { } ["filename"]=> NULL ["http_response"]=> object(WP_HTTP_Requests_Response)#19720 (5) { ["data"]=> NULL ["headers"]=> NULL ["status"]=> NULL ["response":protected]=> object(WpOrg\Requests\Response)#19722 (10) { ["body"]=> string(0) "" ["raw"]=> string(391) "HTTP/1.1 400 Bad Request Server: openresty Date: Tue, 05 Mar 2024 07:26:32 GMT Content-Type: text/html; charset=UTF-8 Content-Length: 1 Connection: close X-Robots-Tag: noindex X-Content-Type-Options: nosniff Expires: Wed, 11 Jan 1984 05:00:00 GMT Cache-Control: no-cache, must-revalidate, max-age=0 Referrer-Policy: strict-origin-when-cross-origin X-Frame-Options: SAMEORIGIN 0" ["headers"]=> object(WpOrg\Requests\Response\Headers)#19723 (1) { ["data":protected]=> array(10) { ["server"]=> array(1) { [0]=> string(9) "openresty" } ["date"]=> array(1) { [0]=> string(29) "Tue, 05 Mar 2024 07:26:32 GMT" } ["content-type"]=> array(1) { [0]=> string(24) "text/html; charset=UTF-8" } ["content-length"]=> array(1) { [0]=> string(1) "1" } ["x-robots-tag"]=> array(1) { [0]=> string(7) "noindex" } ["x-content-type-options"]=> array(1) { [0]=> string(7) "nosniff" } ["expires"]=> array(1) { [0]=> string(29) "Wed, 11 Jan 1984 05:00:00 GMT" } ["cache-control"]=> array(1) { [0]=> string(36) "no-cache, must-revalidate, max-age=0" } ["referrer-policy"]=> array(1) { [0]=> string(31) "strict-origin-when-cross-origin" } ["x-frame-options"]=> array(1) { [0]=> string(10) "SAMEORIGIN" } } } ["status_code"]=> int(400) ["protocol_version"]=> float(1.1) ["success"]=> bool(false) ["redirects"]=> int(0) ["url"]=> string(107) "https://wame.sk/wp-admin/admin-ajax.php?action=async_litespeed&nonce=123123123&litespeed_type=crawler_force" ["history"]=> array(0) { } ["cookies"]=> object(WpOrg\Requests\Cookie\Jar)#19719 (1) { ["cookies":protected]=> array(0) { } } } ["filename":protected]=> NULL } }

https://wame.sk/lscrawl.php

It looks like your server has blocked that request

https://prnt.sc/OJ_uP2QLKxsI

as you can see on my screenshot , when I do that mimic request to my test site , it gives me 200 OK response, while on your site, it ends up in 400 error

and what exactly is your server set up ? the report shows OpenLiteSpeed, but why I see “openresty” ?

Thank you, the problem was a forgotten DNS AAAA record that was still pointing to the old server

does it work now ?

Yes, perfectly.