Use this plugin cautiously!
-
I was using this plugin to scrape prices from amazon. Apparently every time the plugin is called, it downloads the entire webpage that you are scraping and stores it in the wp_options table. This would be fine if the plugin would delete those stored pages after a certain amount of time but it doesn’t! ??
MySQL kept crashing (and taking my dedicated server down with it) because the wp_options for my site grew to 1.3GB (yes, GIGABYTE) whereas this table should normally be less than 1MB. Basically, every time someone visited a page on my site, this plugin was adding a new row of ~300kb of data to the wp_options table. YIKES!
If you have a small site, then maybe this plugin would be okay, but for a larger site that needs to scrape data, this plugin in its current state is not the best solution.
https://www.ads-software.com/extend/plugins/wp-web-scrapper/
- The topic ‘Use this plugin cautiously!’ is closed to new replies.