Is there a cap on preloading?

  • Resolved p15h

    (@prestonwordsworth)


    1 year, 9 months ago

    Hi Saumya

    I hope you are well, and a happy new year to you!

    A quick question here: is there a cap on how many urls are allowed in one preloading operation? We have just under a thousand urls in our four sitemaps, and the log is saying ‘preloading completed’ as soon as a couple of dozen urls get preloaded. So does this represent a hard limit on the number of urls that get preloaded in one go?

Viewing 2 replies - 1 through 2 (of 2 total)
  • Plugin Contributor iSaumya

    (@isaumya)

    Hi @prestonwordsworth,
    by default the preloading limit is 50 URLs. Screenshot: https://i.imgur.com/gbK6aSY.jpeg

    But if you have thousands of URLs in your website, preloaded is really not a good choice. That is because if your server uses cURL to load all those URLs then it would increase the server load a lot.

    Also when CF system will see that most of your requests is coming from one server IP which is requesting the URLs via cURL instead of loading them via actual browser, chances are they won’t cache the pages. This is why for large sites preloader is really not recommended.

    Instead it would be a better choice to enable the Smart Tiered Cache inside Cloudflare Dashboard so that the cache remains longer in the Cloudflare CDN.

    Thread Starter p15h

    (@prestonwordsworth)

    Many thanks for your very helpful explanation, and for the reference to the faq which I should have studied more closely!

    • This reply was modified 1 year, 9 months ago by p15h.
Viewing 2 replies - 1 through 2 (of 2 total)
  • The topic ‘Is there a cap on preloading?’ is closed to new replies.