Allow Semrush bot

  • Resolved cgllc

    (@mfulham)


    2 years ago

    Hello,

    Under Advanced settings > SpamFireWall features, there is an option for:

    Anti-Crawler
    Plugin shows SpamFireWall stop page for any bot, except allowed bots (Google, Yahoo and etc).
    Anti-Crawler includes blocking bots by the User-Agent. Use Personal lists in the Dashboard to filter specific User-Agents.

    I would like to enable this feature. How can I make sure that the Semrush bot is allowed to access the website? I found this information from Semrush about how to Whitelist SemrushBot. How can I implement this in CleanTalk?

    Thank you.

Viewing 2 replies - 1 through 2 (of 2 total)
  • Plugin Support SergeM

    (@serge00)

    Hello, @mfulham.

    Semrush Bot is already being allowed by default in the CleanTalk plugin. Our guide about using User-Agents is here:
    https://cleantalk.org/help/filter-ua

    Did it help?

    Plugin Support sergecleantalk

    (@sergecleantalk)

    We haven’t received your reply in a few days, so I’m going to mark this topic as “resolved”.
    If you have any further questions, you can start a new topic anytime.

Viewing 2 replies - 1 through 2 (of 2 total)
  • The topic ‘Allow Semrush bot’ is closed to new replies.