Viewing 1 replies (of 1 total)
  • Plugin Author A5hleyRich

    (@a5hleyrich)

    Hi there,

    Sorry for the delayed response. I have added the nofollow attribute to download links in the latest update, which should hopefully discourage most genuine crawlers from following the links. However, this is relying that the crawler considers the attribute. I would therefore like to add some crawler detection once a link has been clicked which will check the user agent against a known list of bots. That said, there is no real fool proof way of achieving this as we are still relying on the crawler’s integrity in that they identify themselves as a bot.

    If you have any access logs for the download files I could take a look at that would be really useful.

    Regards,

    Ashley

Viewing 1 replies (of 1 total)
  • The topic ‘Google bot or other spider’ is closed to new replies.