Anyone Know How To Delete A Robots.xt?

  • Hello,

    I recently set up my WordPress Blog and when i installed it i made the Blog not visible to search engines because i wanted to wait until the site was fully constructed before being index.

    Well fast forward, I’m ready to go live and the google bot is trying to crawl my site but its being restricted by this robots.txt with a * Disallow

    I made sure Privacy settings on the Blog was set to – “I would like my blog to be visible by Google, Yahoo, blah blah blah

    I check my server through FTP and i don’t see this Robots.txt file even though i can click on it in my Sites Admin Control panel under Site Stats.

    I know the file or code is somewhere but the issue is i can’t seem to find find it. :weep: My Web host tech support tried to find it but they said it should have been where i was looking (root directory or htaccess)

    Anyone know how i can get rid of this file so Google can index my site?
    Sorry if this is a long post but i wanted to make sure you guys understood where I’m at with this issue.

    ThanX!

Viewing 3 replies - 1 through 3 (of 3 total)

  • robots.txt can appear at any level in the file system. if its not at your site’s root level a likely place to look is in the top level of your wordpress installation. in addition there can be more than one robots.txt – they can go in any folder.

    the setting you are talking about is internal, it doesnt create an actual file.

    Thread Starter 504musicman

    (@504musicman)

    I did an experiment and uploaded a Blank text file (robots.txt)
    and it overwrites the existing file even though this file was Not VISIBLE in the root directory.

    This is the location of where file in question should be
    https://www.makemoneyonlinesafely.com/robots.txt

    But this is weird, when i hit delete on the file i uploaded myself the old robots.txt file comes back.

    My question now is, can i just leave the empty robots.txt on the site so the google bot can do its job.

Viewing 3 replies - 1 through 3 (of 3 total)
  • The topic ‘Anyone Know How To Delete A Robots.xt?’ is closed to new replies.