I can try all the tricks others have mentioned.  Disallowing certain bots in .htaccess.  Or in code trying to unhook em_calendar_get_default_search , undefine EM_AJAX, and other even more esoteric filters and hooks.

All of those are just patches, and perhaps not even adequate ones.

I’ve had three client sites blocked altogether by their hosting companies for excess resource use.  Looking through the logs the Facebook bot alone is hitting every single event with an ajax call, every day.  And since I tend to put targeted calendar events on multiple pages (e.g. “classes” category, “speaking” category) plus the main events page there end up being sometimes multiple hits per event.

There are 90,000+ sites using EventsManager or EventsManager Pro.  I’m managing 10 of those!  Rather than make all of us patch our sites it would make more sense for you to patch the plugin.

My website cannot be scanned (performance and SEO) anymore since I have started using the Solid Security WordPress plug-in. Normally I used tools lake Pagespeed Insights for performance and Screamingfrog for SEO but i think the tools get blocked by the firewall of the plug-in.

Any idea how to fix this? Maybe there is some setting I don’t know about?

Thank you in advance,

Gilles

The WAF lets us set how much of our website’s resources can be used by crawlers and other bots. This gives “out of the box” protection against scripts that could be potentially installed before you would be able to scan malware and boosts the protection against Brute-Force attacks.

You can also block entire IP ranges, but WordFence blocks IPs on its own.

The WP dashboard widget is very intuitive and allows us to have an immediate read of important data, to improve overall security.

As developers, we are granted access to WordFence Central (where we control the security of several websites, in one place).

Overall, Defiant Inc. has an amazing team of programmers and security analysts.

THANK YOU

User-agent: * Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
Sitemap: https://silasantosh.com/sitemap.xml

Will this crawl my multisites like
https://silasantosh.com/masterclass
https://silasantosh.com/spirituality

Or should I add
User-agent: * Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
Sitemap: https://silasantosh.com/sitemap.xml
Sitemap: https://silasantosh.com/spirituality/sitemap.xml
https://silasantosh.com/masterclass/sitemap.xml

If yes, how to do it with the help of the “the seo framework” plugin ?

I think this is more of an topic for Github but I see there is not much or any response for the issues posted there.

This issue is on the core of category Url structure. There must be a reason why you guys handle this but I don see it and crawlers either.

Let me try to explain it as short and easy as possible. Being on the category page the user can select a different category or sub category if the template / theme offers that and the URL structure is fine.
https://wordpress-test.local/product-category/clothing/

But he could also type in the following and the page would not end in a 404:
https://wordpress-test.local/product-category/clothing/accessories/Jackets/Shirts/Jackets/

This is essentially what crawlers like Google, Bing, yandex do. They go down the route even if that makes no sense.
https://wordpress-test.local/product-category/clothing/accessories/Jackets/Shirts/Jackets/Shirts/Jackets/Shirts/Jackets/Shirts/Jackets/

They play this game till there is a 404 that is registered. We have a bunch of 404 errors reported because of exactly this and I’m scratching my head how to prevent this. I created a blank test site to verify that this behavior is not only on the live site. It happens with a clean WP and Woocommerce install.
Redirects make no sense here or are too complicated. Stopping crawlers like Google to crawl product categories is no choice here is my impression.

How to prevent this loop being chased by Bots?

As my audience is increasingly outside of the US, Ive switched to cloudflare to use either DNS or CDN in pursuit of regaining Good page experience in Google Search console. My score in lighthouse and page speed insights continue to be not improved. And Im pursuing LCP improvement on mobile.

TTFB is significantly improved using cloudflare CDN per speed vitals… Though not certain how accurate this is.

Also I use an plugin that streams posts from instgram and updates new content daily on about 100 pages, thus keeping the cache % hit ratio is as high as possible is very important. This is an art site, image heavy. So, Im uncertain as to what I need to do to maximize cache hit ratio and speed for audience users who are in major metro cities, nyc, atl, miami, berlin, london, etc….

The crawler seems to be struggling to complete a complete crawl with cloudflare cdn activated, is this normal?
How does the cache get updated when the Instgram plugin updates and cloudflare integration?

Should I leave quic.cloud can on/off?
The cloudflare plugin, should that be utilized?
Should I complete integration in quic.cloud?
Should cloudflare page rule “cache everything” be implemented?
Should cloudflare APO be considered for my application ?

Thank you in advance for any input.

My blog has multiple low-value/outdated posts that I do not wish to be discovered by Google search crawlers anymore. I don’t want them appearing in Google search results, and I don’t want crawlers following links in those posts.

So, how do I de-index and nofollow the links in certain posts with the Yoast plugin?
Despite knowing that I can do this by clicking on specific articles, and scrolling down to Yoast widget > advanced > (Allow search engines to show this post in search results? ), Should search engines follow links on this Post)

Is that suffice?

The RSS feed looked like it should have worked. It looked ok and was validated as a proper feed through https://validator.w3.org/feed/ but it just wouldn’t show up on any feed readers. So I disabled the CleanTalk plugin and the feed started working again.

I’m assuming the plugin is blocking crawlers from getting to the site. Is there any way to fix this?

Just feels like Yoast add more features and keep on bloating the plugin for features that is extra. Instead of 2020 and soon 2021 try to minimize the code use with the same functionality.

We can disable it but would prefer it extra is added once enabled and not bloating the plugin for users who don’t want those extra features within Yoast or WordPress. Some prefer to have everything within WordPress some prefer to have slim code and bare minimal and use the tools separately.

Thanks in advance.

Just tested Elementor on a brand new website with:

Theme – Twenty Twenty
Plugins – MainWP Child and Elementor

On the following page [ redundant link removed ] I have added a new H2 “Heading #2 – Hidden” and it’s set to be hidden on all devices – https://i.imgur.com/Bi2hXvh.png

It still shows on the source code – https://i.imgur.com/PTPuAUM.png
Elementor sets a “display: none;” CSS property which is a bad practice since Googlebot crawls the source code on the website.

Are you guys planning on fixing this so I can start designing my next client’s projects with Elementor?

Kind regards,
Kristiyan