Sergio Alfaro

Hi Jacob.

I am checking different options like you.

Finally was working fine this option?

In my case I have two extra user roles that I want to use same cache for boths, but using the option that appear in your link to specify same number for both don’t work for me, only save same number one time, I think it’s a bug.

But mainly I want to ask you about the values you set on TTL to maintain all pages cached full time. In my case, seems I lose the cache very fast and I tried a lot of combinations.

Thanks!

Hi!

I think you can work with litespeed crawler.

On crawler settings tab, go to “role simulation” and simply put any ID of one of your customers.

You can go to users, hover mouse on the link of any customer and see in the url the “ID” number.

After that got to litespeed – crawler (separate option, not under settings), and here be sure to enable cron crawler.

Now you will see two queues, one cache for visitors, and other cache for the same user role of the ID (your “customers”).

Should work.

Actually I am doing something similar, now testing times trying to maintain the cache enabled and updated 24h, because in my case seems we lost cache very fast.

Regards.

Thanks!

Yes I do it. But I am not sure about the good values to put here.

I will play with all the options.

Thanks again!

Hi Tishu! Thank you so much for your very fast reply!

Seems that is working now, I think is not adding more url’s to the blacklist.

I say “seems” due for any reason now stops the crawling:

Start watching…
18 Apr 2018 11:04:47 Size: 419 Crawler: #1 Position: 370 Threads: 3 Status: crawling, updated position
…….

Is like is running, but all time is fixed in that.

We have 32 core server and litespeed license for 4 cores. So I think 3 threads should be fine.

Checking server resources while is crawling the CPU usage the “top” change from 3 to 6 of the 32 available cores, and from 5% to 10% of all the available CPU.

Is not a problem with the RAM neither due we have 192Gb.

Maybe is due to any of my settings limitation?

One thing to have in consideration, I added 3 additional ID user roles to crawler, but stay on first one in 370 of 419 url.

Thanks!