• Resolved dreamer_108

    (@dreamer_108)


    Hi all,

    Just a quick question, if I set my page to be private, will the web crawlers be able to actually still crawl the content of my website. I know that if I set a page as a private, normal visitor will not be able to view the page, but what about the web crawlers?

    My goal is to set up a WordPress page to be completely private, I do not want any web crawlers to crawl my website. I do know that google’s crawler adhere to the no crawl instruction, but what about other crawlers?

    Thanks

Viewing 3 replies - 1 through 3 (of 3 total)
  • Moderator James Huff

    (@macmanx)

    The same is true for crawlers. A private post/page requires that you be logged in as the author or an editor or administrator to view, which of course crawlers can’t do. ??

    https://codex.www.ads-software.com/Content_Visibility#Private_Content

    Which setting your site to “Discourage search engines from indexing this site” at Settings -> Reading will indeed instruct Google, Bing, and Yahoo to not index your site, there is no guarantee that other search engines will respect that rule.

    If you’re going to require folks to be logged in to see private posts/pages anyway, have you considered something more like https://www.ads-software.com/plugins/registered-users-only/ ?

    If you go that route, you can publish posts/pages normally (not as private) and register visitors as just subscribers. You won’t need to give them editor or administrator rights just to view posts/pages.

    Thread Starter dreamer_108

    (@dreamer_108)

    Thank you for the helpful insight James!

    Moderator James Huff

    (@macmanx)

    You’re welcome!

Viewing 3 replies - 1 through 3 (of 3 total)
  • The topic ‘Privatizing WordPress Website’ is closed to new replies.