Preloading crashes server

  • Resolved Andreas 2013

    (@andreas-2013)


    1 year, 7 months ago

    Hello,

    I’m using the cache function of WP Optimize and have a big problem when using the preload option. My website contains about 13.000 pages, and each time I run the preload, the result is a crashing server, because preload uses too much resources.

    I found this thread (https://www.ads-software.com/support/topic/control-preload-speed/) and changed the the delay between pages from 50000 to 100000 microseconds. Unfortunately the result is even worse, as you can see in the attached images. The first peak is with 50000 and the second peak with 100000 ms! While preloading process my website isn’t available any more, I also can’t access the backend.

    So I hope, that there is a possibility for this problem!

    Thank you very much for your help in advance!
    Andreas

Viewing 5 replies - 1 through 5 (of 5 total)
  • Plugin Contributor Venkat Raj

    (@webulous)

    @andreas-2013 All preload is doing that it visit’s your site programmatically. So, it will take the same amount of resources if you visit the pages manually.

    The preload doesn’t run as a single task. Once the PHP script reaches the time limit (max_execution_time), the remaining URLs are scheduled to preload later. We do see the possibility and increase the time limit to 30 minutes. What you have done is that increase the interval between batched preload tasks.

    If you don’t want to run a single preload task for 30 minutes, then you can reduce it by defining a constant WP_OPTIMIZE_SET_TIME_LIMIT to your desired seconds.

    Thread Starter Andreas 2013

    (@andreas-2013)

    Hi Venkat Raj,

    thank you for your reply!

    I’m not sure, if I understand right the process of preloading. When the limit of 30 minutes is reached, the preload stops automatically, and afterwards it starts again with the remained URLs, and so on? But could you explain me, please, the meaning of the attaced graphics? Why is the use of memory increasing up to 7.5 GB? What will happen, if I change the time limit to 15 minutes?

    Plugin Contributor Venkat Raj

    (@webulous)

    @andreas-2013 When you reduce the time limit, the usage spike will be for short periods rather than long. One possible explanation for high memory usage is that if your site uses lots of different set of scripts/styles in each pages, then minify assets will be created for those sets separately.

    Could you please deactivate/activate the WP-Optimize and see if that fixes issue?

    That said, it seems system (disk I/O, network communication, etc) too take lot of resource apart from WP-Optimize’s PHP process?

    Thread Starter Andreas 2013

    (@andreas-2013)

    @webulous Could you explain, please, how and where to use WP_OPTIMIZE_SET_TIME_LIMIT ?

    Plugin Contributor Venkat Raj

    (@webulous)

    @andreas-2013 Please add following line in your wp-config.php file
    define('WP_OPTIMIZE_SET_TIME_LIMIT', 300);

    This will result in 5 minute preload chunks

Viewing 5 replies - 1 through 5 (of 5 total)
  • The topic ‘Preloading crashes server’ is closed to new replies.