Nrelate on a robot blocked site
-
We have a test site we want to verify this on before running it live. The test site has a robot.txt file blocking all robots. Does your service circumvent this?
Also, do you use the data you index for any other purpose? We don’t want links to the test site showing up somewhere.
Viewing 1 replies (of 1 total)
Viewing 1 replies (of 1 total)
- The topic ‘Nrelate on a robot blocked site’ is closed to new replies.