hostwolf

there should be someone with geek powers who can answer this ??

That’s the one! Thanks a lot.

First of all a little insight about how shared hosting works. You are put together with hundreds of other people on one server. You usually have a limit of 20% CPU usage and 20 simultaneous MySQL connections – something that you will most likely get all the time since your site is very popular/big. A shared hosting account is just not for your kind of traffic if you use dynamically generated content.

I am hosting a cheap web hosting directory on bluehost and have never had any problems.

For your requirements at Links.com I would suggest a VPS from either Lunarpages or HostIcan both of which offer 24/7 support and are reliable in terms of uptime.

I don’t list 1&1 in my web hosting directory because I hear a lot of mixed feedback. My blog is hosted on Bluehost. Also Hostmonster, HostIcan and Lunarpages are very good for wp blogs.

Synhosting looks like a solid company but I usually prefer affordable web hosts that have been a bit longer in the business and were able to establish a record over the years.

There is plenty of evidence that this works if you read these SERPS. People at sitepoint also confirmed this.

Meanwhile I found out that this can actually be done. It doesn’t conform to the robots.txt standards but Google and Slurp accept it so that’s as good as it gets.

I just implemented

User-Agent: *
Disallow: */feed/

btw the example url you posted are the exact urls I want to get out of the search engines. They are nothing but pollution.

That what I meant by

But there are still other spots for spiders to access your feeds. I am going to post about removing them.

Those are the other spots for the spiders to access feeds. I think one needs to remove these in the php source code but I’m not sure whether that would cause trouble with upgrading in the future.

I can’t see how to solve this solely with robots.txt

well basically the answer I came up with myself is to add this to the robots.txt

Disallow: /blog/feed/
Disallow: /blog/comments/feed/

But there are still other spots for spiders to access your feeds. I am going to post about removing them.

Ah yes, well do you have any ideas as to what could cause this?

Thanks samboll.

This looks like the best one to use to care of all eventualities without hard coding:

Options +FollowSymLinks
RewriteEngine On
RewriteBase /
RewriteCond %{REQUEST_URI} !^/robots\\.txt$ [NC]
RewriteCond %{HTTP_HOST} !^www\\.[a-z-]+\\.[a-z]{2,6} [NC]
RewriteCond %{HTTP_HOST} ([a-z-]+\\.[a-z]{2,6})$ [NC]
RewriteRule ^/(.*)$ https://%1/$1 [R=301,L]

I′m just wondering why is it {2,6} and not {1,9} ? Isn′t that statement supposed to take care of all numerals or am I missing something?

And what does the request for robots.txt do? Or what′s the purpose?

Thank you Otto, clearing the cache really worked. I completed step 1 but am still having a problem with the redirect.

I implemented your htaccess directive in the root directory of https://www.cheap-webhosting.in/
if you go there and click the non www link in the top right to my blog you will see that it doesn’t get redirected.

When I put this directive in the folder of my blog it just redirects to my home page.

Is there something I missed?

Ok, thank you those are the steps I will try to implement.

First I need to get rid of this persistent and mysterious redirection that changes my https://www.cheap- urls to get an extra www.

This is my .htaccess `# BEGIN WordPress
<IfModule mod_rewrite.c>
RewriteEngine On
RewriteBase /blog/
RewriteCond %{REQUEST_FILENAME} !-f
RewriteCond %{REQUEST_FILENAME} !-d
RewriteRule . /blog/index.php [L]
</IfModule>

# END WordPress`

Just checked and there is nothing left in my headers.php either. There is no .htaccess in a folder above that could cause this. I′m really a bit clueless what else to try.
Could I just unzip the new wp2.1.3 and keep my wp-config.php plus the upload folder and maybe two or three other files to overwrite the whole thing.

I’m starting to consider a more forceful approach to problem solving at this stage ??

<?php
  $host = $GLOBALS['HTTP_SERVER_VARS']['HTTP_HOST'];
  $request = $GLOBALS['HTTP_SERVER_VARS']['REQUEST_URI'];
  header("HTTP/1.0 301 Moved Permanently");
  header("Location: https://www.$host$request");
  header("Connection: close");
?>

but I deleted it and uploaded the original headers.php so I don′t know how this should have caused a problem. However you are right that this did cause the original problem of making my site appear like https://www.www.cheap-etcetera when I tried to type in xxwww.cheap-webhosting.in

btw I edited my link as the backticks don′t seem to work – I don′t want to raise suspicions of spamming