the crawler doesn’t work

you mean like it works for some page , and it doesn’t work for some page ?

and also please do me a full screenshot on your crawler summary page

Hi, I can’t upload the image.

Below are the required results:

Guest – WebP – 10 minutes – 155miss

Guest – WebP- 10 minutes – 5 hit – 150 miss

Guest – mobile – 10 minutes – 155miss

Guest – 10 minutes – 155 miss

Current sitemap crawl started at: 26m 17s ago

The next complete sitemap crawl will start at: 01/28/2024 20:13:52

Last complete run time for all crawlers: 634 seconds

Run time for previous crawler: 32 seconds

Current crawler started at: 7m 44s ago

Current server load: 3.19

Last interval: 7m 44s ago

Ended reason: end

Last crawled: 155 item(s)

you can upload image to somewhere like imgur.com

but from what you posted , it shows the crawler is working , what makes you think it doesn’t ?

View post on imgur.com

sometimes it works and sometimes it doesn’t.

when I test on a site like this: https://www.bytecheck.com/

on the second try on the same url it works.

yes , because when you send out request , the request header will also effect the cache status , the 3rd party test site , may not have same request as real browser or crawler does

so is it normal to see in that image that I posted all those URLs in miss?

yes , both blue and green means the crawler is working

the blue/miss means the page was NOT cached before but now has been cached by crawler