• Hi everyone, first post, first wordpress site.

    I am having an issues with google crawling my site, the googlebot is coming back with the following error

    “Googlebot is blocked from https://www.exclusivelybath.co.uk/”

    Originally I had the default wordpress privacy set to hide the site, now i have changed that to allow all search engines.

    I have also added a robots.txt file into the root of the directory.

    pretty much allowing the spiders to crawl everything.

    Where am i going wrong as when i go to google webmaster tools and ask the spider to crawl my site, it keeps coming up with the same error?

    I think this is what is playing up adsense also as it cant crawl the site for ‘text’ so its not showing ads..

    site:
    https://www.exclusivelybath.co.uk

    Please any help would be appreciated.

    Kind regards

    lee

Viewing 4 replies - 1 through 4 (of 4 total)
Viewing 4 replies - 1 through 4 (of 4 total)
  • The topic ‘Robots.txt is driving me insane…anyone’ is closed to new replies.