Option to add robots.txt entries

  • Hi,

    On the plugin page it says

    “Option to add new robots.txt rules. These can be used to further control (read: limit) the indexation of various parts of your site and subsequent spread of pagerank across your sites pages.”

    I have an issue that there is an extra line present in my robots.txt and I don’t know where it is coming from. The reading settings are setup in a way that the plugin generates this robots.txt.

    I tries going through the settings of “XML Sitemap & Google News” plugin but did not find anything related to robots.txt generation.

    Question: Where is the “option to add new robots.txt rules” found?

    Thanks,
    Marko

Viewing 1 replies (of 1 total)

  • Hi Marko, the option to add robots.txt rules can be found on Settings > Reading under the main sitemap activation option. But I fear it will not let you remove existing rules…

    Full robots.txt control is considered for a future version but at this point you can only add custom rules/lines.

Viewing 1 replies (of 1 total)
  • The topic ‘Option to add robots.txt entries’ is closed to new replies.