white list crawler bot of agent

  • Resolved peterlingolate

    (@peterlingolate)


    4 years, 1 month ago

    It appears that I can’t use my MissingLttr service: I white listed their IP adresses already but don’t know how to white list their crawler bot:

    The Missinglettr Bot

    In some cases, you may also need to whitelist our Crawler Bot. Our Bot uses the following User Agent string:

    Mozilla/5.0 (compatible; MissinglettrBot/2.0; +https://missinglettr.com/bot/)

    The page I need help with: [log in to see the link]

Viewing 4 replies - 1 through 4 (of 4 total)
  • Plugin Author alexandergull

    (@alexandergull)

    Hello @peterlingolate

    At this moment, version 5.152.4 passes all the agents by default.

    Please, update the plugin.

    Make sure you have enabled the option “Block bots by User-Agents”. This option applies the filtration rules for agents.

    If you have more questions about this, contact us via https://cleantalk.org/my/support/open, this way we can see your logs.

    Be well,

    Thread Starter peterlingolate

    (@peterlingolate)

    I can’t find the option “Block bots by User-Agents” on “Advanced settings” Was it removed?

    Plugin Author alexandergull

    (@alexandergull)

    Yes, we removed this option in version 5.152.5 released yesterday.

    This option now works by default and not visible for users.

    Be well,

    Plugin Support katereji

    (@katereji)

    Hello.
    We haven’t heard back from you in a while, so I’m going to mark this thread as “resolved” – if you have any further questions, you can start a new thread.

Viewing 4 replies - 1 through 4 (of 4 total)
  • The topic ‘white list crawler bot of agent’ is closed to new replies.