Using crawler only for updated products

  • Resolved septero

    (@septero)


    1 year, 4 months ago

    Hi,

    I have an online WooCommerce store with about 4,500 items. Each product price and stock is updated from the supplier’s xml file every 1 hour.

    For a large part of the products, stock and price remain unchanged. Is it possible to have Crawler only go through products that have been updated? Currently, the crawler uses the sitemap and goes through all the pages, which takes a very long time and uses server resources.

    With best regards

Viewing 4 replies - 1 through 4 (of 4 total)
  • Plugin Support qtwrk

    (@qtwrk)

    when crawler passes all the pages, if it’s already cached page , then it doesn’t really take any resources, it’s literally as serve a static request.

    you can try create a sitemap aiming on the changed product only though.

    Thread Starter septero

    (@septero)

    Hi,

    Thanks for answer. Will it be possible to set the crawler to start at the specific time (e.g. in the middle of the night)? Server load and traffic is usually lower at night so it will be ideal time for crawler to pass requested pages.

    With best regards

    Plugin Support qtwrk

    (@qtwrk)

    unfortunately there is no such feature

    I will ask our dev as feature requests.

    Thread Starter septero

    (@septero)

    Hi,

    Thank you for looking into this. I appreciate your help in forwarding the feature request to your development team. If there are any updates or progress on this matter, please do let me know.

    With best regards

Viewing 4 replies - 1 through 4 (of 4 total)
  • The topic ‘Using crawler only for updated products’ is closed to new replies.