robots.txt to just allow the homepage?
-
Howdy,
I’m after the correct robots.txt code that will allow just the indexing of the wordpress blog homepage and exclude everything else.
(It’s for a school website so I’m not that bothered about SEO, I really only want the homepage to appear in google)
So far I’ve come up with:
Sitemap: https://www.mysite.com/sitemap.xml User-agent: * Disallow: /wp-content/ Disallow: /wp-icludes/ Disallow: /trackback/ Disallow: /wp-admin/ Disallow: /admin/ Disallow: /archives/ Disallow: /category/ Disallow: /chiefblog/ Disallow: /edjourneys/ Disallow: /friends/ Disallow: /tag/* Disallow: /tag/ Disallow: /tmp/ Disallow: /wp-* Disallow: /login/ Disallow: /*.js$ Disallow: /*.inc$ Disallow: /*.css$ Disallow: /*.php$ Disallow: /*.ico$ User-agent: All Allow: / User-agent: Googlebot-Image Disallow: / User-agent: ia_archiver Disallow: / User-agent: duggmirror Disallow: /
Cheers in advance, C.
Viewing 2 replies - 1 through 2 (of 2 total)
Viewing 2 replies - 1 through 2 (of 2 total)
- The topic ‘robots.txt to just allow the homepage?’ is closed to new replies.