Should caches be disallowed with a robots.text?

  • Resolved Hazlo

    (@hazlo)


    11 years, 5 months ago

    Hello Frank
    My question is about the relationship between caches and Google indexation.
    I have a cache folder on my server with both Lite cache and Autoptimize caches inside.
    And I wonder if I should disallow this folder with the robots.text or not.
    If i don’t, is there a duplicate content risk?
    And if I do… will my posts and pages still be indexed properly?
    It’s quite important to be sure with this point I guess!
    Thanks in advance for your advice, and also, of course, for your very good plugin.

    https://www.ads-software.com/extend/plugins/autoptimize/

Viewing 2 replies - 1 through 2 (of 2 total)
  • Plugin Author Frank Goossens

    (@futtta)

    Can’t speak with absolute certainty for Lite Cache, but it certainly is no problem as far as Autoptimize’s is concerned, as the cache folder only holds css/ js and no content (HTML). As such, the info in there is of no use to crawlers in general and Google in particular.

    Thread Starter Hazlo

    (@hazlo)

    Thanks for answering Frank. I get it better now.
    Best.

Viewing 2 replies - 1 through 2 (of 2 total)
  • The topic ‘Should caches be disallowed with a robots.text?’ is closed to new replies.