Robots.txt is driving me insane…anyone
-
Hi everyone, first post, first wordpress site.
I am having an issues with google crawling my site, the googlebot is coming back with the following error
“Googlebot is blocked from https://www.exclusivelybath.co.uk/”
Originally I had the default wordpress privacy set to hide the site, now i have changed that to allow all search engines.
I have also added a robots.txt file into the root of the directory.
pretty much allowing the spiders to crawl everything.
Where am i going wrong as when i go to google webmaster tools and ask the spider to crawl my site, it keeps coming up with the same error?
I think this is what is playing up adsense also as it cant crawl the site for ‘text’ so its not showing ads..
site: https://www.exclusivelybath.co.ukPlease any help would be appreciated.
Kind regards
lee
- The topic ‘Robots.txt is driving me insane…anyone’ is closed to new replies.