16000+ Past Due

  • Resolved techguysa

    (@techguysa)


    10 months, 3 weeks ago

    HI all. im going crazy so anuually i do a purge of products by creating a CSV stock file with all the SKU’s and set the stock to Zero and the price to null (blank) so that it will update that SKU to null so once i update stocks that are available it will show me what has still is null is basically end of life and i can then mark them off this method is just easier than checking 1 by 1 14 thousand times.

    Now the problem is action schedual has pass due crons so its doing them very slowly but more so its causing MySql to use a LOT of CPU power causing everything to slow down.

    Server is a VPS with 8cores 12gb ram and 500gb ssd

    I have modified via WHM the inoodb cache to match what the Physical Ram has (2/3rds) so instead of taking 700% cpu and 5% memory its doing less CPU and more memory (now like 15-25%) so back end is a little moveable than before.

    My only thought is that the crons are taking waaay too much resource

    on WP Control i noticed this

    “wt_iew_do_cron_import” shows on Recurrence
    This interval is less than the WP_CRON_LOCK_TIMEOUT constant which is set to 60 seconds. Events that use it may not run on time.

    and on Scheduled Actions shows this
    “Action Scheduler migration in progress. The list of scheduled actions may be incomplete.”

    whats showing is the following

    • All (4198082)
    • Complete (661567)
    • Pending (16733)
    • Failed (3519764)
    • Canceled (18)
    • Past-due (16733)

    Search hook, args and claim ID: Select bulk action

    16,733 items? ? Current Page of 1,674 Next page? Last page?

    This is records for 3 years mind you it was nearly 18k past-due 2-3 days ago I have put the site on maintanance mode and stop the imports of products and de-activated google ads/facebook/mailchimp hopefully causing it to skip but its still busy going slowly and eating CPU

    Under logs on the top (oldest) past due is

    1. 2024-01-03 01:58:30 +0000
      action created
    2. 2024-01-04 09:06:36 +0000
      action reset
    3. 2024-01-04 09:42:49 +0000
      action reset
    4. 2024-01-04 11:13:18 +0000
      action reset
    5. 2024-01-04 11:58:25 +0000
      action reset
    6. 2024-01-04 12:16:32 +0000
      action reset
    7. 2024-01-04 12:25:41 +0000
      action reset
    8. 2024-01-04 12:29:38 +0000
      action reset
    9. 2024-01-04 12:42:57 +0000
      action reset
    10. 2024-01-04 12:57:40 +0000
      action reset
    11. 2024-01-04 13:14:09 +0000
      action reset
    12. 2024-01-04 13:19:05 +0000
      action reset
    13. 2024-01-04 13:31:27 +0000
      action reset
    14. 2024-01-04 13:43:50 +0000
      action reset

    I really need help here I dont know how WP CLI works i have access to WHM and CPanel etc i can modify the config files if have to etc i just need to know what to do.

    or do i delete all past due what would happen cause the front page they look right.

Viewing 4 replies - 1 through 4 (of 4 total)
  • Thread Starter techguysa

    (@techguysa)

    Possible solution to my issue.

    WP Control (Cron Events)
    showed Hook “wt_iew_do_cron_import”
    Which is (Action) “Wt_Import_Export_For_Woo_Cron->do_cron_import()
    wp-content/plugins/wt-import-export-for-woo/admin/modules/cron/cron.php:336″

    I paused it and BOOM its incredibly fast now. not sure what the cause is on that but its going smooth and less CPU usage.

    Recurrence side does show still
    “Every 5 second
    This interval is less than the WP_CRON_LOCK_TIMEOUT constant which is set to 60 seconds. Events that use it may not run on time.”

    So unsure if that is the cause

    Have tested importing CSV files and those work. cant say the cron scheduals are working yet as im waiting for the whole thing to finish (typing this its on
    All (4197880) | Complete (661674) | Pending (15070) | Failed (3521118) | Canceled (18) | Past-due (15070)

    Search hook, args and claim ID:
    Select bulk action
    15,070 items ? ?
    Current Page
    of 1,507 Next page? Last page?

    So once this is down all the way ill reenable that cron i suspect its rebuilding tables etc kinda annoying at the state it does this

    Considering the hooks are
    woocommerce_run_product_attribute_lookup_update_callback

    gla/jobs/update_products/process_item (these are set to fail since i disabled the plugin to make this process faster) i dont mind letting it run afterwards just doing 1 product 3 times is a bit much
    MailChimp_WooCommerce_Single_Product (Same as above its always delayed anyway)
    and others

    Plugin Support Saravanan S, a11n

    (@simplysaru)

    Hi @techguysa,

    Your solution to stop the product import export is a good one. It also looks like actions are being scheduled/rescheduled and don’t really get to execute.

    With that said, given the no of action scheduled (failed) consider cleaning them up. Instructions on how to clean up failed actions is here. Please do these after creating ample backups of your store. You may want to consider using the high volume version of the action scheduler for your needs. You can check it out here. Do monitor how the pending actions are completed once you use the high volume version and tweak it as necessary. Cleaning up the failed actions and pausing syncing(gla/import etc) will significantly speed up the completions. Do monitor the progress on their completion and work towards completing all the past due actions.

    Do keep us posted on how the recommended suggestion works out for you.

    Thread Starter techguysa

    (@techguysa)

    So after monitoring it for a few days seems everything is not older than 24hours given i have been giving it work to do as well. but they went fast i even logged some on my end to cehck they did over a thousand in a few short hours.

    All (4196004) | Complete (660139) | Pending (12934) | Failed (3522913) | Canceled (18) | Past-due (12934)

    Search hook, args and claim ID:
    Select bulk action
    12,934 items ? ?
    Current Page
    of 1,294 Next page? Last page? 11:30 am 5th Jan

    All (4196003) | Complete (660168) | Pending (12785) | Failed (3523032) | Canceled (18) | Past-due (12785)

    Search hook, args and claim ID:
    Select bulk action
    4,196,003 items ? ?
    Current Page
    of 419,601 Next page? Last page? 12:09 5th Jan

    All (4192424) | Complete (656933) | Pending (11210) | Failed (3524263) | Canceled (18) | Past-due (11210)

    Search hook, args and claim ID:
    Select bulk action
    4,192,424 items ? ?
    Current Page
    of 419,243 Next page? Last page? 18:54 5th jan

    All (4192419) | Complete (657000) | Pending (10908) | Failed (3524493) | Canceled (18) | Past-due (10908)

    Search hook, args and claim ID:
    Select bulk action
    4,192,419 items First page? Previous page?
    Current Page
    of 419,242 ? ? 20:16 5th jan

    All (4192414) | Complete (657212) | Pending (9988) | Failed (3525196) | Canceled (18) | Past-due (9988)

    Search hook, args and claim ID:
    Select bulk action
    9,988 items ? ?
    Current Page
    of 999 Next page? Last page? 00:20 6th Jan

    All (4189823) | Complete (654665) | Pending (9730) | Failed (3525410) | Canceled (18) | Past-due (9730)

    Search hook, args and claim ID:
    Select bulk action
    9,730 items ? ?
    Current Page
    of 973 Next page? Last page? 01:27 6th jan

    All (4182750) | Complete (647948) | Pending (7797) | Failed (3526987) | Canceled (18) | Past-due (7797)

    Search hook, args and claim ID:
    Select bulk action
    4,182,750 items ? ?
    Current Page
    of 418,275 Next page? Last page? 09:58 6th jan

    All (4182751) | Complete (648041) | Pending (7404) | Failed (3527288) | Canceled (18) | Past-due (7404)

    Search hook, args and claim ID:
    Select bulk action
    7,404 items ? ?
    Current Page
    of 741 Next page? Last page? 11:43 6th jan

    All (4182751) | Complete (648063) | Pending (7355) | Failed (3527315) | Canceled (18) | Past-due (7355)

    Search hook, args and claim ID:
    Select bulk action
    7,355 items ? ?
    Current Page
    of 736 Next page? Last page?

    11:57 6th jan

    ============================================================================================================================================================
    All (4182758) | Complete (648283) | Pending (6853) | Failed (3527604) | Canceled (18) | Past-due (6853)

    Search hook, args and claim ID:
    Select bulk action
    6,853 items ? ?
    Current Page
    of 686 Next page? Last page?

    14:10

    ==============================================================================================================================================================
    uploaded all suppliers stocks and pricing 6th Jan 2024 mid afternoon ish till 22:30 +/-

    All (4203705) | Canceled (18) | Complete (659471) | Failed (3528454) | Pending (15762) | Past-due (15754)

    Search hook, args and claim ID:
    Select bulk action
    15,755 items ? ?
    Current Page
    of 1,576 Next page? Last page? 000:06 7th jan

    All (4200646) | Canceled (18) | Complete (657179) | Failed (3529388) | Pending (14061) | Past-due (14055)

    Search hook, args and claim ID:
    Select bulk action
    14,055 items ? ?
    Current Page
    of 1,406 Next page? Last page? 07:51

    All (4199779) | Canceled (18) | Complete (656914) | Failed (3530037) | Pending (12810) | Past-due (12804)

    Search hook, args and claim ID:
    Select bulk action
    12,804 items ? ?
    Current Page
    of 1,281 Next page? Last page?

    13:41

    ==============================================================================================================================================================

    They on 700 this morning but after i gave it a few thounsands to do *(stock updates etc)

    looks like i can just leave that hook on pause as well since evertyhing is working again

    ill check those links you sent out on the high volume not sure if 12gb of ram and 8 cores cpu wise helps

    Plugin Support Saravanan S, a11n

    (@simplysaru)

    Hi @techguysa,

    Thanks for working on this and keeping tabs on this. Your specs on the RAM and CPU cores does help, and I think these should be sufficient, for High-volume version.
    Do keep us posted on how these recommendations works for you.

Viewing 4 replies - 1 through 4 (of 4 total)
  • The topic ‘16000+ Past Due’ is closed to new replies.