workcy

Ah I’m sorry ??

Thank you very much

Thank you

Yoast SEO shouldn’t write to it

But doesn’t yoast update the robots.txt if I set a page for “no indexing” for search engines? I always wondered why the denied block is always empty

hmmm. robots=1 produces a “too many redirects” error

EDIT: But if I open /en/?robots=1 then I get the virtual robots.txt
They are only identical at the moment because I created the robots.txt file yesterday with temporary file_edit enabled over yoast file editor.

• This reply was modified 1 year, 6 months ago by workcy.

LiteSpeed Cache

Yes I saw the documentation for the cache plugins. The cache plugin pushes the page completly into the browsercache. If I clear the browser cache then the original page shows also the block message.

But for me this behavior is okay, because even if the bot can reopen the original page then every further request is blocked.

I tried a differend test approach with another browser and a VPN.

The blocking works even with translatepress. I think it was the whitelist for admin + my caching plugin.

Because after the ban with VPN I can still open the site where I clicked the ban link, but every other site shows then the block message.

So everything works fine.

Sorry for this thread ??