• Resolved zaburt

    (@zaburt)


    Since updating to 5.14.0 site has become unresponsive as the database is busy creating fulltext index “ALTER TABLE wp_posts ADD FULLTEXT yarpp_content (post_content)”. Our site has 200000+ posts running on a quite resourceful environment. Fulltext index generation is running for 20 minutes now, using all of the database resources, rendering the site useless. Thankfully we try in our test environment first, but I can’t put this change to production as is.

    We did not have any speed issues with YARRP until now, but with this change I suspect since the index will be very big, adding lots of new disk IO, it will slowdown all of our site and related operations (data sync from production to test etc.) terribly. Is there a solution for this other than removing YARRP from all of our systems ?

Viewing 5 replies - 1 through 5 (of 5 total)
  • Plugin Support Michael Nelson

    (@mnelson4)

    Hi @zaburt, thanks for reporting this issue, and good idea to test the update on a staging site, especially for such a big site.
    YARPP has been the fulltext indexes when YARPP is activated for a few versions now, but this is the first version that will actually automatically add the indexes to when upgrading YARPP. It sounds like that’s not going to work for such a massive site.
    We’re looking into what options we can offer for such large sites, especially if you don’t need the fulltext index for using post title and content for YARPP comparisons.

    Plugin Support Michael Nelson

    (@mnelson4)

    Hey @zaburt I’ve created a modified version of the plugin which only adds the database indexes when needed (when you enable comparing by post titles or bodies).
    So, for your site, that will mean it won’t add the indexes unless you decide to use titles or bodies (you might want to enable just titles, which will only add the index on titles, which I think might be easier on your DB but still improve related results).

    Would you like to take a look and let me know what you think?

    1. Download the new version from here: https://drive.google.com/file/d/1kCNqPq8YAhzLwWd3GG9BsHbxOSMyEUdf/view?usp=sharing
    2. Go to your WordPress dashboard, click plugins, then “add new”, then “upload” and select the zip file you just downloaded
    3. Deactivate the previous version of YARPP
    4. Activate the new version of YARPP

    If you’re too busy, no worries, but we will try to get this out soon in order to avoid any other large sites from having this issue.

    Thread Starter zaburt

    (@zaburt)

    Thank you for the quick response ! I have tried the updated version above it has worked great;

    * Did not have any issues on updating the plugin
    * Enabling FT on titles worked much better on our test environment (under simulated user interaction). Index generation time was 22 minutes (on posts), now it is 89 seconds (titles only). Generated index size (FTS_*) dropped to 0.8%
    * the note about index timings and adding index manually is really a good idea

    I can try other things too if you want. With the current approach when you make a release we are planning to enable index on titles. Thanks again.

    Plugin Support Michael Nelson

    (@mnelson4)

    YARPP 5.15.1 incorporates the work you tested and a few other things.
    Please let us know if you have any issues.
    We’re thinking of putting more weight on post titles in YARPP’s algorithm, so I might ping you again here if you’d like to try it out beforehand to see if it improves the results at all.
    Feel free to reopen if this issue comes up again.

    Thread Starter zaburt

    (@zaburt)

    Updated to 5.15.1 and enabled fulltext index on titles, we don’t have any issues. We can try out other changes too, ping me when you need.

Viewing 5 replies - 1 through 5 (of 5 total)
  • The topic ‘5.14.0 rendered our site unusable’ is closed to new replies.