Robot.txt invalid

  • Resolved gabasj

    (@gabasj)


    1 year, 2 months ago

    After I install the SEO plugin and run pagespeed insights, I keep getting this error for robots.txt. Does the plugin even generate this archive?


    robots.txt is not valid. Lighthouse did not download a robots.txt file

    If your robots.txt file is invalid, crawlers may not be able to understand how you want your site to be crawled or indexed.

    The page I need help with: [log in to see the link]

Viewing 4 replies - 1 through 4 (of 4 total)
  • Plugin Author Anh Tran

    (@rilwis)

    Hi,

    I see you have a static/physical robots.txt file on your site. So, the errors come from the file content. Slim SEO only adds a link to the sitemap in the robots.txt file if there is NO static/physical robots.txt file.

    Thread Starter gabasj

    (@gabasj)

    Yes, I had to create a robots.txt for this site. Can you asure that the link to the sitemap has been added?

    Plugin Author Anh Tran

    (@rilwis)

    I see your robots.txt file already includes the correct URL to the sitemap.

    Thread Starter gabasj

    (@gabasj)

    Thankyou for your support and fast response.

Viewing 4 replies - 1 through 4 (of 4 total)
  • The topic ‘Robot.txt invalid’ is closed to new replies.