I completed parts 1 and 2 on your Check if the plugin is working page. Using a VPN, I found the link in the source code and went to the link. I got no feedback in the browser on that first visit or on any other visit, while the VPN was running.
When I went to:
Admin > Blackhole Pro > Bad Bots
I saw the request I’d made via the VPN browser. So, the plugin was logging it, but it wasn’t having an affect on my hitting the page.
Does that sound like a scenario where page caching is having a negative effect?