robots.txt
-
In my site stats I have recently been getting a lot of referrers with /robots.txt at the end. Some come from regular big companies but a lot come from weird places and from sites that could have no possible interest in my blog.
It does not seem to be doing any harm but can anybody tell me what this is.
Thanks
Viewing 12 replies - 1 through 12 (of 12 total)
Viewing 12 replies - 1 through 12 (of 12 total)
- The topic ‘robots.txt’ is closed to new replies.