How to block Site scraper?

  • Resolved suprim

    (@suprim)


    5 years, 8 months ago

    Hello,

    I have been using the plugin for a while now there were few websites who were scraping my site. But Cidram stopped those site from scraping the site, but recently I noticed they have started to scrape again even though I have Cidram installed. Whenever I post an article same article is published on those websites. The only thing I have done was upgraded my cloudflare form free to pro and turn on the WAF settings on Cloudflare could that be the reason cidram not working properly?

    Thank you

Viewing 2 replies - 1 through 2 (of 2 total)
  • Plugin Author Maikuolan

    (@maikuolan)

    Hi Suprim,

    Cloudflare shouldn’t generally interfere with normal operation of CIDRAM, and if both are set up correctly, it should be perfectly okay to use both Cloudflare and CIDRAM together.

    Any idea which IP addresses were responsible for this more recent scraping? It could be possible that the people, services, or bots responsible for this more recent scraping might be operating from new IP ranges that CIDRAM isn’t yet familiar with, might be citing new user agents, or might be exhibiting some other slightly differently behaviour which is allowing them through. If you’re able to share with me the IP addresses responsible for this more recent scraping, or if you’re able to share some of the corresponding entries from your access logs (with any sensitive information redacted first, of course; WordPress support forums are publicly accessible, after all), I can investigate further, to better determine what needs to be done next.

    Cheers. ??

    Plugin Author Maikuolan

    (@maikuolan)

    I assume resolved, due to no more replies since 3 weeks ago. Marking accordingly.

Viewing 2 replies - 1 through 2 (of 2 total)
  • The topic ‘How to block Site scraper?’ is closed to new replies.