How to easily prevent entire site from being crawled
-
I network activated AI1SEO on one of my sites. I went to the General Settings > Noindex Settings panel and checked each of the boxes (see screen shot) in an effort to block the entire site without having to do it on a page-by-page basis.
Yet, when I view page-source on one of the pages, the <meta> tag has the pages as index-able:
<meta name="robots" content="index,follow,noodp,noydir" />
Is there an easy way to prevent the entire site from being crawled or must I do it page by page?
Thanks.
Viewing 2 replies - 1 through 2 (of 2 total)
Viewing 2 replies - 1 through 2 (of 2 total)
- The topic ‘How to easily prevent entire site from being crawled’ is closed to new replies.