MaxMind Recommendation – Comments Anyone?

  • Resolved webQuest

    (@cwsleigh)


    7 years, 5 months ago

    I’m moving towards implementation of the MaxMind GeoIP2 Precision web services product, for use in conjunction with the Slim Stat Analytics plugin’s MaxMind Integration add-on.

    As part of the ‘welcome’ email from MaxMind, included is the caveat:
    To prevent search engines spiders from depleting your GeoIP service lookups, we recommend the use of the robots exclusion standard.

    My concern is that I want the Google and Bing spiders to crawl my website. I’d be willing to take the hit on my ‘GeoIP service lookups’ for those two search engines.

    At this point, my purpose and concern is to anticipate possible issues, and proactively address them in advance.

    Anyone with experience using this feature of the MaxMind Integration add-on? Has this been much of an issue for you?

    From my vantage point, it seems too bad that the MaxMind services cannot filter out spider activity … but I do not ‘know enough’ to have a sense if that could be an answer to this issue that they provide from their end ..?..

    Or, … maybe Slim Stat Analytics could in some way have their integration add-on not pass forward service lookups when the activity is being generated from a search engine spider ..?..

Viewing 1 replies (of 1 total)
  • Thread Starter webQuest

    (@cwsleigh)

    Here is the response I have received, so far, from the good folks at MaxMind:

    Hello,

    It is correct that we cannot filter requests on our end to detect any kind of potential bot activity. We know that would be useful, but unfortunately adding any additional filters or checks would greatly impact the service.

    Since you want web-crawlers to index your site, you’ll just need to make sure that you are not sending us repeat queries. The best way to do this is to employ data caching on your end. We update our database weekly, on Tuesdays, so you could cache our response for up to a week without losing accuracy (if you have already queried a certain IP that week, then refer to the cached data instead of querying that IP again during the same week). That way, bots can hit your pages as much as they need to, and will only consume a single query per week instead of one for each visit (which can be a massive drain).

    I hope that is helpful! Please let me know if I can be of further assistance, or if you have any questions.

    Regards,
    Customer Support
    MaxMind, Inc.

    So, with that said, is the data caching ‘on my end’ (described above) a feature that is already handled by Slim Stat Analytics, or could be in the future?

    Or is that something which I would need to ‘turn on’ some other place within my WordPress environment? And what would the potential ‘downsides’ be of doing that?

    Comments / Answers ..?..

Viewing 1 replies (of 1 total)
  • The topic ‘MaxMind Recommendation – Comments Anyone?’ is closed to new replies.