My web is not indexed by Google – robots.txt or sitemap xmls

Hi @coffeetalkingnet,

I’m working with some colleagues at WordCamp US Contributor Day and we are discussing your issue. A more knowledgable colleague than myself suggests that you may want to investigate the .htaccess file on your install. There may be some code in there that is overriding your Yoast, WordPress and robots.txt settings.

Hi, This might be simple, but to start… is the “Discourage search engines from indexing this site” unchecked? under SETTINGS > Reading ?

Hi @liamdempsey, thanks for your answer.

I don’t know how to configure .htaccess, but the file on my root directory does not seem to have any special thing related to my problems I post it here as I think it does not contain any private info:

# BEGIN WordPress
<IfModule mod_rewrite.c>
RewriteEngine On
RewriteBase /
RewriteRule ^index\.php$ – [L]
RewriteCond %{REQUEST_FILENAME} !-f
RewriteCond %{REQUEST_FILENAME} !-d
RewriteRule . /index.php [L]
</IfModule>

# END WordPress

Also, as I wrote, I cannot understand why the sitemap files does not reside in the root folder as expected.

Thanks again,

Roger

Hi @kimwhite,

No, I don’t have search engines discouraged. I had that version checked until a WEEK ago, but I understand that a week is enough time for Google to be able to index my website, specially due to the fact that I explicitly ask it to index it from the search console.

What other options I have to investigate what’s happening ?

Thanks,

Roger

I have just checked it again, writing in the google search:

site:coffeetalking.net

… And now it works ! I think the problem was I was writing it with www:

site:www.coffeetalking.net

Should it work with www, or this is expected behaviour ?

Thanks

This is how the sitemap xml appears to be working with my sites so I assume this is expected.

As for your site if you search site:coffeetalking.net you will see your pages are listed. I do not understand why you are not ranking. Perhaps google documentation or forms could help?

Hi @kimwhite, and thanks again.

The indexing seems to be working by now.

Regards,

Roger

Everything seems to be working now. It was just a matter of checking the indexation by searching “site:coffeetalking.net” in Google, and wait a few hours.