Is it possible to control the crawling speed?

  • Resolved offminded

    (@offminded)


    8 years, 12 months ago

    Hi,
    Thanks for the plugin. I was wondering, is it possible to control the speed of the crawling process? To set an interval for crawling process? For example: only crawl 1 page/second?

    Regular crawling speeds seems to put an extra load on our server and I if there is traffic it might make our backend unresponsive or crash it.

    Thanks.

    https://www.ads-software.com/plugins/warm-cache/

Viewing 2 replies - 1 through 2 (of 2 total)
  • Plugin Author ramon fincken

    (@ramon-fincken)

    Not yet, but I am working on this

    Plugin Author ramon fincken

    (@ramon-fincken)

    It crawls 20 pages each cronjob call.

    You are free to adjust the amount of cronjobs you want each hour.
    And .. you are able to adjust the 20 pages to any amount of pages in you wp-config.

Viewing 2 replies - 1 through 2 (of 2 total)
  • The topic ‘Is it possible to control the crawling speed?’ is closed to new replies.