I want to use an app on my website but it is being blocked by the booter bots and crawler manager plugin. How do I whitelist it?

Am using this plugin to rate limit Pinterest crawlers from DDosing my site with a lot of requests , is there a why to Whilst Normal Users from Rate Limiting ???

Getting an error on the site:
Notice: Undefined index: HTTP_USER_AGENT in?/wp-content/plugins/booter-bots-crawlers-manager/includes/RequestBlocker.php?on line?45

Deleting and removing plugin did not get this to go away.

hi, is there a way to whitelist ip? seems it block payment gateway data coming in.

Hi, great plugin but need some advice for the setting, we are using woocommerce but when enable the “reject link” it will block our webstore receiving order status data from payment gateway when end-user make payment. need advice for the setting.

Hi there,

If I want booter to send 410 to all the url containig ?s= (like mydomain.com/?s=xxxxxxx) what should I use as a regular expression?

I can’t seem to get it right.

Thanks for the help

Angelo

Hi,

Trying this …

So far, noticing that many bots are not being caught such as > mj12bot

Perhaps I have missed a setting?

Many Thanks

I have activated your plugin 2 days before and my reject list is almost 70-80 URLs out of 5-6 URLS are not getting removed permanently. e.g embed.js, font woff file URLs.
This is the robots text file
https://healthcarentsickcare.com/robots.txt

Is there is any correction required in above file?
if not, how much time it takes crawlers to index 410 requests? I am still adding reject list everyday around 30 URLs

Hi, thanks for the plugin.

This option: “Include WooCommerce Filtering URLs” doesn’t specify if it will include these urls to a block list or to a whitelist?

I use woocommerce so it’s important for this to be clear, please explain

Thank you

Is this compatible with page caching plugin? I use LiteSpeed Cache plugin.

Hi,

Your plugin interest me because my hosting send me lot of alert for php request.

But after activation i just can’t work in admin, i was blocked for every action, and impossible to deactivate it, because every time after i was unblocked, if i just try to go to Extension i was blocked again.

Then i delete it via FTP.

Can i know how to delete it completly, if have another file?

Thanks

Hello

I have noticed that the “Screaming” bot is flaged as bad bot. However, the “Screaming Frog” tool is using that boot the find crawl errors. As far as I know, it’s not malicous.

Could you look at it again?