Anti-Crawler turned on causes W3C validator to fail.

Hello.
We have disabled the ability to check the option ‘Block by User-Agent’ in the latest version 5.152.5 of the Anti-Spam plugin. It is turned on by default.
To whitelist the specific bot we need to know the IP. You could find it in your logs here: https://cleantalk.org/my/show_sfw
But if you are sure that the issue is caused by the Anti-Crawler, you can turn it off. WordPress Admin Page —> Settings —> Anti-Spam by CleanTalk —> Anti-Crawler
Did it help?
Be well.

Hello,
I have the same trouble…
You’ll find here the Debug Log

ArrayObject Object
(
[storage:ArrayObject:private] => Array
(
[12:50:31_ACTION__FUNCTION_] => Array
(
[0] => Failed.
Query: ALTER TABLE kra2019_cleantalk_sfw_logs
CHANGE status status ENUM(‘PASS_SFW’,’DENY_SFW’,’PASS_SFW_BY_WHITELIST’,’PASS_SFW_BY_COOKIE’,’DENY_ANTICRAWLER’,’DENY_ANTIFLOOD’) NOT NULL AFTER ip;
Error: Unknown column ‘status’ in ‘kra2019_cleantalk_sfw_logs’
)

[07:27:38_ACTION__FUNCTION_] => Array
(
[0] => Failed.
Query: ALTER TABLE kra2019_cleantalk_sfw_logs
CHANGE status status ENUM(‘PASS_SFW’,’DENY_SFW’,’PASS_SFW__BY_WHITELIST’,’PASS_SFW__BY_COOKIE’,’DENY_ANTICRAWLER’,’PASS_ANTICRAWLER’,’DENY_ANTIFLOOD’,’PASS_ANTIFLOOD’) NOT NULL AFTER ip;
Error: Unknown column ‘status’ in ‘kra2019_cleantalk_sfw_logs’
)

)

)

When I desactivate the plugin, no more problem.
If I stop Firewall option it’s better, but not completly…

Hello, @adweb2021

According to your data, issue is caused by the “Anti-Flood” and “Anti-Crawler” options. You may disable them in plugin settings and check the results.

If you know what IPs are exactly being blocked, please, add them in your SpamFireWall Whitelist here:
https://cleantalk.org/my/support/open

It should solve the issue.

Actually – we have the same issue.
This could be fixed if there would be a way to exclude the RSS feeds from “Anti-Crawler”.
I tried entering the URL into “URL exclusions”, but that didn’t help.

@greenrhyno, @adweb2021, @markcanada

According to WC3 documentation they are using the IPs from 128.30.52.0/24 subnet.
https://validator.w3.org/services

Please, add this subnet in your SpamFireWall Whitelist here:
https://cleantalk.org/my/show_private?service_type=spamfirewall

After that press “Synchronize with cloud” button in plugin settings to synchronize the plugin with cloud.

Did it help?

We also added subnet 128.30.52.0/24 in our global whitelists, now there should be no blocks.

Just press “Synchronize with cloud” button in plugin settings.

Thank you.

Thank you, but that would only work for this tester. There are many testers out there and many automated RSS retrieval systems.
Like e-mail software that pulls feeds for newsletters: MailChimp, ActiveCampaign….. and their IP addresses can change.
I assume that even some desktop RSS readers may have issues because they get a webpage instead of a feed.?
We needed to disable the Anti-Crawler now. Even if we don’t want bots to crawl the main site, the RSS feed is actually ideal to be “crawled” and until that can be excluded for every access we can’t use the anti-crawl.

@markcanada

Most of all well-known services are whitelisted already, and we are constantly adding new services.

Anyway, you can keep the anti-crawler option disabled. It doesn’t affect anti-spam functionality.