How to distribute the preoad workload over time?

  • Resolved challet

    (@challet)


    9 months ago

    Hello,

    To my understanding, the preload feature refreshes all at once ?

    Would there be a way to make it refresh only expired items ? With the right initial time shaking (by randomizing expire times on the first run), that could spread the work load over each run of the cron.

    An other way to describe it (or an other technical approach maybe) would be that the garbage collector, instead of deleting expired items, would refresh them.

    Any thought ?

    • This topic was modified 9 months ago by challet. Reason: title typo
Viewing 3 replies - 1 through 3 (of 3 total)
  • Plugin Author Donncha O Caoimh (a11n)

    (@donncha)

    Preloading runs fairly slowly, and iterates over your posts.

    Refreshing, rather than deleting, is a good idea, but would likely overwhelm a server if done too quickly, so garbage collection might have to be running continuously.

    Thread Starter challet

    (@challet)

    garbage collection might have to be running continuously

    That was indeed the idea, or at least with short enough delay between runs. That would also require some randomness in the initial expire times, for pages not to expire all at the same time.

    Please see it as a suggestion, the preloading current pace you pointed out works without any overloading.

    Thanks. I’ve noted the idea here so we won’t forget about it. It might even be better than preloading as only popular pages visited by humans (and bots) will be refreshed or preloaded, rather than wasting time preloading all pages.

Viewing 3 replies - 1 through 3 (of 3 total)
  • The topic ‘How to distribute the preoad workload over time?’ is closed to new replies.