Robot txt

  • Resolved arnaudfpm

    (@arnaudfpm)


    1 year, 7 months ago

    Hello,

    in the robot txt file I added these two sentences in bold for google discover :

    User-agent: *
    Disallow: */trackback/
    Disallow: */xmlrpc.php
    Disallow: /wp-*.php
    Disallow: /cgi-bin/
    Disallow: /wp-admin/
    Allow: */wp-content/uploads/
    News Allow: /
    Discover Allow: /

    Can it pertrude the file ? Is it correct ?

Viewing 1 replies (of 1 total)
  • Plugin Support Peter

    (@petersquirrly)

    Hi @arnaudfpm,

    Thank you for reaching out!

    What Squirry offers by default is enough. And unfortunately, I’m not familiar with custom robots declaration. I’ll ask around and if I find anything related I’ll make sure to get back to you, but can’t make any promises at this point.

    Thank you for your understanding.

Viewing 1 replies (of 1 total)
  • The topic ‘Robot txt’ is closed to new replies.