• Resolved squarecandy

    (@squarecandy)


    I understand that some obscure bots may need to be sorted out manually, but I’m surprised to see Google and Yandex not being classified as known bots automatically. I checked the IPs and they are legit, not fakes. Shouldn’t these be on the list of legitimate bots?

    Don’t really care about Yandex, but obviously Google is THE most important bot not to accidentally block.

Viewing 5 replies - 1 through 5 (of 5 total)
  • Plugin Author Cory Marsh

    (@bitslip6)

    First, thank you so much for the feedback I really appreciate it.

    This is a little bit misleading, and you are correct that those are legit googlebots. I’m not entirely sure why they are listed as “unknown” here. Possibly a connectivity issue to the main BitFire bot database when the requests came in.

    Look at the “hit” count; that is the number of times the bot was passed through the firewall. The “miss” count is the number of times the bot was blocked. You can see that it is passing the traffic.

    Version 4.0 should be released in the next few days and is about 3 months of work rewriting the browser identification. We have added over 180 browsers, 3,000 bots, and agent fingerprinting from over 2,000 devices to identify the library used to make the request uniquely. In addition, we have city-level IP geo-tracking, a new binary log that can show every request to the website, extended the logging to over 32,000 requests, and completely overhauled the bot identification system.

    The pricing model is also changing. See: https://bitfire.co/pricing2. I’d like to send you a free gift for providing this feedback. Send an email to [email protected]

    If there is anything you would like me to take a look at I would be happy to discuss with you!

    Kind regards, Cory

    Thread Starter squarecandy

    (@squarecandy)

    Awesome, thanks for the info! Really looking forward to seeing 4.0 and how things progress. Sending you an email about a few other things separately.

    Thread Starter squarecandy

    (@squarecandy)

    Whoops, looks like your email is not working currently.

    554 5.1.1 <[email protected]>: Recipient address rejected: undeliverable address: host mail-outgoing.**************.local

    550 5.7.1 <[email protected]>: Recipient address rejected: Mailbox is out of service (in reply to RCPT TO command)

    Plugin Author Cory Marsh

    (@bitslip6)

    my mistake, still haven’t switched email domains yet. use: [email protected]

    Plugin Author Cory Marsh

    (@bitslip6)

    Closing as fixed in 4.0. All core search engine (Google, Bing, automattic, duck duck, etc ..) IPS also hard coded to skip DNS lookups for these bots.

Viewing 5 replies - 1 through 5 (of 5 total)
  • The topic ‘Well known bots being marked unknown’ is closed to new replies.