To little items in feed

  • Resolved infoturfmastercoza

    (@infoturfmastercoza)


    4 years, 4 months ago

    I tried all the trouble shooting but no luck so far, only get about a third off all the products. I tried xml and csv same results.
    Help! I have none or less products in my product feed than expected
    1 The “Include product variations” feature has been disabled;
    I do not have variations but I tried it with no luck.
    2 The “Only include default product variation” has been enabled;
    Tried it with no luck
    3 The default item_group_id field mapping has been removed;
    Do not have groups but tried it with no luck
    4 Created filters;
    Tried with and without no luck.
    5 WP-cron has been disabled or is broken;
    re installed it tried with and without no luck
    6 Caching plugins block updates or creation of product feeds;
    cleared the cache, deactivated and activated still no luck

    The page I need help with: [log in to see the link]

Viewing 15 replies - 1 through 15 (of 19 total)

  • Hi,

    Thanks for using our plugin and reaching out to us.

    Would you be so kind as to share the plugin debug.log with us? It will help us understand how you have configured your product feed. Instructions on how to retrieve it can be found here: https://adtribes.io/send-your-debug-log-to-support/

    Thread Starter infoturfmastercoza

    (@infoturfmastercoza)

    https://www.turfmaster.co.za/wp-content/uploads/woo-product-feed-pro/logs/debug.log

    Thanks for sharing the debug.log. It seems you are on a pretty old version of PHP (5.5.3). Our plugin supports PHP 5.6 and higher so changes are the issue is caused by this. Would it be an option for you to upgrade to at least 5.6 but ideally 7 or higher?

    Thread Starter infoturfmastercoza

    (@infoturfmastercoza)

    I am confused now it says

    November 3, 2020, 12:56 pm
    Array
    (
    [PHP] => 7.4
    [Wordpress] => 5.5.3
    [WooCommerce] => 4.6.1
    [WooCommerce Product Feed PRO] => 9.0.0

    Apologies, my bad, I wasn’t paying attention (it was your WordPress version).

    We can’t find anything strange in your debug.log either. You mentioned you already tested with the “Include product variations” option enabled. That did not make any difference?

    Can you share the WooCommerce fatal error logs of today/yesterday? Perhaps there is something in there that explains why there are fewer the expected products in your feed. You can find the WooCommerce fatal error logs here: https://docs.woocommerce.com/document/finding-php-error-logs/

    Thread Starter infoturfmastercoza

    (@infoturfmastercoza)

    2020-11-03T07:11:50+00:00 CRITICAL Allowed memory size of 268435456 bytes exhausted (tried to allocate 20480 bytes) in /usr/www/users/turfma/wp-includes/meta.php on line 1078

    2020-11-03T13:41:05+00:00 CRITICAL Allowed memory size of 268435456 bytes exhausted (tried to allocate 20480 bytes) in /usr/www/users/turfma/wp-includes/meta.php on line 1078

    Hi,

    Thanks for sharing this. Is this the content of your entire fatal error logs?

    I am not entirely sure if this out of memory size is the cause of the feed not being complete however you can try lowering the batch size of the plugin. See: https://adtribes.io/batch-size-configuration-product-feed/

    When you do so, also delete todays fatal error log so you can see if the errors return when you reprocess the feed again.

    Thread Starter infoturfmastercoza

    (@infoturfmastercoza)

    Thanks for sharing this. Is this the content of your entire fatal error logs?
    Yes it is and looks the same on the last 2 days.

    I am not entirely sure if this out of memory size is the cause of the feed not being complete however you can try lowering the batch size of the plugin. See: https://adtribes.io/batch-size-configuration-product-feed/
    I changed it to 200 and it is giving me 504 items now from previous 497
    https://www.turfmaster.co.za/wp-content/uploads/woo-product-feed-pro/logs/debug.log

    When you do so, also delete todays fatal error log so you can see if the errors return when you reprocess the feed again
    There is no fatal error log for today so far

    Thread Starter infoturfmastercoza

    (@infoturfmastercoza)

    Found these error logs on our hosting service console.

    Date Level Originating
    IP Address Error Message Apache
    Error Code File
    Path
    2020-11-04 08:56:56 Error 23.94.145.33 [client 23.94.145.33] ModSecurity: Warning. String match within “.asa/ .asax/ .ascx/ .axd/ .backup/ .bak/ .bat/ .cdx/ .cer/ .cfg/ .cmd/ .com/ .config/ .conf/ .cs/ .csproj/ .csr/ .dat/ .db/ .dbf/ .dll/ .dos/ .htr/ .htw/ .ida/ .idc/ .idq/ .inc/ .ini/ .key/ .licx/ .lnk/ .log/ .mdb/ .old/ .pass/ .pdb/ .pol/ .printer/ .pwd/ .rdb/ .resources/ .resx/ .sql/ .swp/ .sys/ .vb/ .vbs/ .vbproj/ .vsdisco/ .webinfo/ .xsd/ .xsx/” at TX:extension. [file “/opt/modsecurity/owasp-modsecurity-crs/rules/REQUEST-920-PROTOCOL-ENFORCEMENT.conf”] [line “1034”] [id “920440”] [msg “URL file extension is restricted by policy”] [data “.log”] [severity “CRITICAL”] [ver “OWASP_CRS/3.3.0”] [tag “application-multi”] [tag “language-multi”] [tag “platform-multi”] [tag “attack-protocol”] [tag “paranoia-level/1”] [tag “OWASP_CRS”] [tag “capec/1000/210/272”] [tag “PCI/6.5.10”] [hostname “turfmaster.co.za”] [uri “/wp-content/uploads/woo-product-feed-pro/logs/debug.log”] [unique_id “X6JQuJ5kwADYLiJo09DSogAAADU”]

    2020-11-04 08:56:51 Error 54.208.185.156 [client 54.208.185.156] ModSecurity: Warning. String match within “.asa/ .asax/ .ascx/ .axd/ .backup/ .bak/ .bat/ .cdx/ .cer/ .cfg/ .cmd/ .com/ .config/ .conf/ .cs/ .csproj/ .csr/ .dat/ .db/ .dbf/ .dll/ .dos/ .htr/ .htw/ .ida/ .idc/ .idq/ .inc/ .ini/ .key/ .licx/ .lnk/ .log/ .mdb/ .old/ .pass/ .pdb/ .pol/ .printer/ .pwd/ .rdb/ .resources/ .resx/ .sql/ .swp/ .sys/ .vb/ .vbs/ .vbproj/ .vsdisco/ .webinfo/ .xsd/ .xsx/” at TX:extension. [file “/opt/modsecurity/owasp-modsecurity-crs/rules/REQUEST-920-PROTOCOL-ENFORCEMENT.conf”] [line “1034”] [id “920440”] [msg “URL file extension is restricted by policy”] [data “.log”] [severity “CRITICAL”] [ver “OWASP_CRS/3.3.0”] [tag “application-multi”] [tag “language-multi”] [tag “platform-multi”] [tag “attack-protocol”] [tag “paranoia-level/1”] [tag “OWASP_CRS”] [tag “capec/1000/210/272”] [tag “PCI/6.5.10”] [hostname “turfmaster.co.za”] [uri “/wp-content/uploads/woo-product-feed-pro/logs/debug.log”] [unique_id “X6JQs55kwADYLiJo09DSgQAAAAE”]
    2020-11-04 08:55:11 Error 35.184.160.78 [client 35.184.160.78] ModSecurity: Warning. Pattern match “\\\\b(?:keep-alive|close),\\\\s?(?:keep-alive|close)\\\\b” at REQUEST_HEADERS:Connection. [file “/opt/modsecurity/owasp-modsecurity-crs/rules/REQUEST-920-PROTOCOL-ENFORCEMENT.conf”] [line “338”] [id “920210”] [msg “Multiple/Conflicting Connection Header Data Found”] [data “close, close”] [severity “WARNING”] [ver “OWASP_CRS/3.3.0”] [tag “application-multi”] [tag “language-multi”] [tag “platform-multi”] [tag “attack-protocol”] [tag “paranoia-level/1”] [tag “OWASP_CRS”] [tag “capec/1000/210/272”] [hostname “turfmaster.co.za”] [uri “/SCAG Zero Turn Mower – Turf Tiger 26hp 61.pdf”] [unique_id “X6JQT55kwADYLiJo09DPJgAAADU”]

    2020-11-04 08:47:16 Error 41.161.84.138 Got error ‘PHP message: WordPress database error Deadlock found when trying to get lock; try restarting transaction for query DELETE FROM TM_options WHERE option_name = ‘_transient_jetpack_sync_callables_await’ made by shutdown_action_hook, do_action(‘shutdown’), WP_Hook->do_action, WP_Hook->apply_filters, Automattic\\Jetpack\\Sync\\Sender->do_sync, Automattic\\Jetpack\\Sync\\Sender->do_sync_and_set_delays, Automattic\\Jetpack\\Sync\\Sender->do_sync_for_queue, do_action(‘jetpack_sync_before_send_queue_sync’), WP_Hook->do_action, WP_Hook->apply_filters, Automattic\\Jetpack\\Sync\\Modules\\Callables->maybe_sync_callables, get_transient, delete_option, W3TC\\DbCache_WpdbNew->delete, W3TC\\DbCache_WpdbInjection_QueryCaching->delete, W3TC\\_CallUnderlying->delete, W3TC\\DbCache_WpdbNew->delete, W3TC\\DbCache_WpdbInjection->delete, W3TC\\DbCache_WpdbNew->default_delete, W3TC\\DbCache_WpdbNew->query, W3TC\\DbCache_WpdbInjection->query, W3TC\\DbCache_WpdbNew->default_queryPHP message: WordPress database error Deadlock found when trying to get lock; try restarting transaction for query DELETE FROM TM_options WHERE option_name = ‘_transient_timeout_jetpack_sync_callables_await’ made by shutdown_action_hook, do_action(‘shutdown’), WP_Hook->do_action, WP_Hook->apply_filters, Automattic\\Jetpack\\Sync\\Sender->do_sync, Automattic\\Jetpack\\Sync\\Sender->do_sync_and_set_delays, Automattic\\Jetpack\\Sync\\Sender->do_sync_for_queue, do_action(‘jetpack_sync_before_send_queue_sync’), WP_Hook->do_action, WP_Hook->apply_filters, Automattic\\Jetpack\\Sync\\Modules\\Callables->maybe_sync_callables, get_transient, delete_option, W3TC\\DbCache_WpdbNew->delete, W3TC\\DbCache_WpdbInjection_QueryCaching->delete, W3TC\\_CallUnderlying->delete, W3TC\\DbCache_WpdbNew->delete, W3TC\\DbCache_WpdbInjection->delete, W3TC\\DbCache_WpdbNew->default_delete, W3TC\\DbCache_WpdbNew->query, W3TC\\DbCache_WpdbInjection->query, W3TC\\DbCache_WpdbNew->default_query’ AH01071

    2020-11-04 08:47:15 Error 41.161.84.138 Got error ‘PHP message: Error checking in buffer: There are no checked out buffers’ AH01071

    2020-11-04 08:46:25 Error 169.239.126.186 [client 169.239.126.186] ModSecurity: Warning. String match within “.asa/ .asax/ .ascx/ .axd/ .backup/ .bak/ .bat/ .cdx/ .cer/ .cfg/ .cmd/ .com/ .config/ .conf/ .cs/ .csproj/ .csr/ .dat/ .db/ .dbf/ .dll/ .dos/ .htr/ .htw/ .ida/ .idc/ .idq/ .inc/ .ini/ .key/ .licx/ .lnk/ .log/ .mdb/ .old/ .pass/ .pdb/ .pol/ .printer/ .pwd/ .rdb/ .resources/ .resx/ .sql/ .swp/ .sys/ .vb/ .vbs/ .vbproj/ .vsdisco/ .webinfo/ .xsd/ .xsx/” at TX:extension. [file “/opt/modsecurity/owasp-modsecurity-crs/rules/REQUEST-920-PROTOCOL-ENFORCEMENT.conf”] [line “1034”] [id “920440”] [msg “URL file extension is restricted by policy”] [data “.log”] [severity “CRITICAL”] [ver “OWASP_CRS/3.3.0”] [tag “application-multi”] [tag “language-multi”] [tag “platform-multi”] [tag “attack-protocol”] [tag “paranoia-level/1”] [tag “OWASP_CRS”] [tag “capec/1000/210/272”] [tag “PCI/6.5.10”] [hostname “turfmaster.co.za”] [uri “/wp-content/uploads/woo-product-feed-pro/logs/debug.log”] [unique_id “X6JOQZ5kwADYLiJo09DE1AAAAAc”]

    Thread Starter infoturfmastercoza

    (@infoturfmastercoza)

    however you can try lowering the batch size of the plugin. See: https://adtribes.io/batch-size-configuration-product-feed/
    I changed it to 200 and it is giving me 504 items now from previous 497
    I ran it again with batch size 150 and it now went up to 540 it just takes a couple off minutes to refresh

    Thread Starter infoturfmastercoza

    (@infoturfmastercoza)

    Changed batch size back to default still not right but now I get 609 products, almost half of what it should be.
    Also noticed that when I change a description it takes about 3 to 4 hours before it changes in the feed.

    Thread Starter infoturfmastercoza

    (@infoturfmastercoza)

    Still not getting all the products, the few that it went up with was my colleague adding more products.

    Do any of the products that are not making to your feed have a “strange” product type?

    Our plugin supports:
    – Simple products
    – Variable products – its variations

    Only from the official WooCommerce plugins:
    – Bundled products
    – Composite products
    – Mix & Match products
    – Auction products
    – Subscription products

    Also the post status of the products needs to be “publish”. Drafts or hidden products do not make it to the feed.

    Thread Starter infoturfmastercoza

    (@infoturfmastercoza)

    No its all Simple products and it shows published

    And are you sure this exclude rule is not the cause of the issue?

                        [1604145586615] => Array
                        (
                            [rowCount] => 1604145586615
                            [attribute] => image
                            [condition] => empty
                            [criteria] => 
                            [than] => exclude
                        )

    Did you try removing that rule to see what it does to the number of products in your feed?

Viewing 15 replies - 1 through 15 (of 19 total)
  • The topic ‘To little items in feed’ is closed to new replies.