robots.txt has formatting error

  • Resolved frontagemarketing

    (@frontagemarketing)


    4 years, 8 months ago

    My site audit in SEM Rush is telling me that my robots.txt has a formatting error. Since this file is being generated by the XML sitemap plugin, it seems I cannot edit, only add?

    This is the error from SEM Rush:

    Invalid line
    Sitemap: https://www.axela-tech.com/sitemap.xml User-agent: *

    How can I correct this issue?

    The page I need help with: [log in to see the link]

Viewing 2 replies - 1 through 2 (of 2 total)

  • Hi, the sitemap and user agent should be on seperate lines like this:

    
Sitemap: https://www.axela-tech.com/sitemap.xml 

User-agent: *

    so it seems something is minifying the robots.txt output. I suspect it’s the same as what is minifying your site HTML output. Is it a plugin? If so, can you exclude the URL /robots.txt ?

    I suggest also excluding the robots.txt repsonse from Cloudflare caching…

Viewing 2 replies - 1 through 2 (of 2 total)
  • The topic ‘robots.txt has formatting error’ is closed to new replies.

Tags