Robots.txt and disavow

  • Should we disavow wp-content/cache/seraph…. folder or is it not recommended? The google crawler is parsing files like /wp-content/cache/seraphinite-accelerator/s/m/d/css/*.css and in order to preserve the google crawl budget, should we disavow the cache folder?

Viewing 1 replies (of 1 total)
  • Plugin Author Seraphinite Solutions

    (@seraphinitesoft)

    Hi.

    Yes, these are ordinary CSS files that are only optimized. So, it can be excluded. The whole directory can be, yes.

Viewing 1 replies (of 1 total)
  • The topic ‘Robots.txt and disavow’ is closed to new replies.