WordPress and robots.txt
-
The engines may crawl pages which look like this:
https://netzjahre.com/2016/06/23/logger-canmore-gp-102-g-porter-routes-poi-ovi-verarbeiten-2/
I do not need help for this case.But I need help here: I want to prevent search engines to crawl pages which look like this:
https://netzjahre.com/2016/06/23/
(URL ending with /yyyy/mm/dd/)
I have a lot of work in my robots.txt if I start with /2016/01/01 and stop with /2021/12/31.
But I want to handle my robots.txt as simple as possible. Is there a solution?Please help, thx in advance,
JosefThe page I need help with: [log in to see the link]
Viewing 2 replies - 1 through 2 (of 2 total)
Viewing 2 replies - 1 through 2 (of 2 total)
- The topic ‘WordPress and robots.txt’ is closed to new replies.