LiteSpeed Crawler – Lite version (New Feature)
-
So while I am using a shared host that does NOT support the LiteSpeed Crawler to it’s shared clients, it got me thinking…
Can you give a website like mine (we have 800k+ hundreds of thousands of pages) the ability to use the crawler in a smaller manner… Meaning it could be limited to say 100 pages to refresh each day? I think I can do that now (and do it now) with our homepage) but this is merely a purge, not a crawl from what I understand.
Note: using the “Scheduled Purge URLs” setting with a time under general settings.Would LOVE if we could prime the cache using this feature (for shared hosting clients like me where I can’t run the entire crawler) on a limited scale & limited number of pages. Bottom line, can the plugin do it so it doesn’t require the server to authenticate this request as a “lite” version? Also, I know Wordfence use to do some of this with their old “falcon” cache engine – which has since been deprecated since they are a security firm – which was decent just two years ago. Food for thought.
Love your thoughts / suggestions / feedback.
Dave
- The topic ‘LiteSpeed Crawler – Lite version (New Feature)’ is closed to new replies.