robots.txt question

  • This may be a dumb question, but… ??

    I’ve set up my robots.txt file based off the sample in the WP Codex at: https://codex.www.ads-software.com/Search_Engine_Optimization_for_WordPress

    However, I’ve been curious as to why one would allow the indexing of:

    /wp-content/uploads

    The reason I ask is because I have a photo blog, and I try to be protective of the images on my website. For instance, I definitely concur with disallowing Google-bot Image.

    I’m contemplating NOT allowing the indexing of the /wp-content/uploads. Would there be an unintended negative consequence to doing that?

    Any clarification on why /wp-content/uploads is allowed in the sample robots.txt would be appreciated.

    Thanks so much for any assistance.

    Deb Phillips

Viewing 2 replies - 1 through 2 (of 2 total)

  • I don’t allow any of my /wp-content folder to be indexed
    everything works fine

    Thread Starter debncgal

    (@debncgal)

    Thank you, samboll. I think I’ll follow suit and not allow indexing of the /wp-content/uploads folder, too. I’m still perplexed as to why that folder is specifically allowed in the WP sample robots.txt file.

Viewing 2 replies - 1 through 2 (of 2 total)
  • The topic ‘robots.txt question’ is closed to new replies.