Robots.txt

  • Hey all,

    WordPress is creating a virtual robots.txt with the command /Disallow.
    How can i edit this file? is there a plugin? or should i upload to my FTP?

Viewing 5 replies - 1 through 5 (of 5 total)

  • Hi there, why do you want to edit the robots.txt file?

    If is is showing the following, then you should leave it as is:

    User-agent: *
Disallow: /wp-admin/

    Otherwise, if its disallowing the entire site, then go to Settings > Reading > Search Engine Visibility and makes sure that the checkbox for “Discourage search engines from indexing this site” is not ticked.

    Thread Starter roira

    (@roira)

    it is showing

    User-agent: *
    Disallow: /

    I want to edit it…

    My site is still under construction …
    how can i edit the file? via plugin or ftp ?

    You won’t be able to edit the file via FTP as it doesn’t exist.

    You can either:

    1) Create a file called robots.txt via FTP and then add anything you want to it

    2) Install Yoast SEO and then edit the robots.txt file from there

    Either option should work fine for you, but Yoast might be better if your code knowledge is limited.

    Thread Starter roira

    (@roira)

    Hey thx i edited it via Yoast i didn’t even imagine that this option exists!

    Great, glad you got it right! Good luck ??

Viewing 5 replies - 1 through 5 (of 5 total)
  • The topic ‘Robots.txt’ is closed to new replies.