• Dear WordPressers,

    I had the time to read about everything related to robots.txt and I already modified the robots.txt file of my website in this way:

    User-agent: *
    Disallow: /
    Allow: /wp-content/uploads/
    Allow: /wp-content/blogs.dir/

    However, I would like to ask you how can I allow certain pages/posts to be crawl by search engines as well ?

    Any idea?

    • This topic was modified 4 years, 11 months ago by Jan Dembowski. Reason: Moved to Fixing WordPress, this is not an Everything else WordPress topic
Viewing 3 replies - 1 through 3 (of 3 total)
Viewing 3 replies - 1 through 3 (of 3 total)
  • The topic ‘Robots.txt’ is closed to new replies.