General HTTP error: 404 not found

The robots.txt is automatically generated by wordpress. It should be in your wordpress root, for example yourdomain.com/robots.txt

If you open the sitemaps settings page (Settings -> XML Sitemap) it should show you something like this:

The URL to your sitemap index file is: …./sitemap.xml.

Not exists, 404 not found, I have a re-direct plugin for all 404 errors and redirect to homepage. I can not open in browser

Would it be possible that I can check the problem directly on your blog? Please email me at himself …. arnebrachhold … de

Thanks!

I send you an email

Hi Arnee,

Please let me know once you are able to resolve the issue for producerspot, as now i am also facing exactly tha same issue after installing rewrite inspector.

Regards,
ToolsQA

Can you both check if sitemap.xml.gz instead of just sitemap.xml is working for you?

Hey, seems like it worked with xml.gz. Will update you in case face any issue now.

Thanks for your help
ToolsQA

toolsqa, are you also using the 404 Redirection plugin?

HI Arnee,

Still the same issue after 5 mins, all the urls have error now.
I am very new to wordpress and not sure what kind of redirecting i m using. But no 404 redirection plugin. I have faced these issues after installing w3total cache. I initially had issues with my feed but that is now resolved.

Please let me know if you need anything else from me or if you like to investigate my issue with my credential. I can share it with you.

Regards,
ToolsQA

I have fixed two issues, please try to install this version:

https://downloads.www.ads-software.com/plugin/google-sitemap-generator.zip

Hi Arnee,

Still the same issue with new install.
I found this in my .htss file, see if you understand this, i am not this much technical:
<IfModule mod_rewrite.c>
RewriteEngine On
RewriteCond %{REQUEST_FILENAME} !-f
RewriteCond %{REQUEST_FILENAME} !-d
RewriteCond %{REQUEST_URI} !(robots\.txt|sitemap(_index)?\.xml(\.gz)?|[a-z0-9_\-]+-sitemap([0-9]+)?\.xml(\.gz)?)
RewriteCond %{REQUEST_FILENAME} \.(css|htc|js|js2|js3|js4|html|htm|rtf|rtx|svg|svgz|txt|xsd|xsl|xml|asf|asx|wax|wmv|wmx|avi|bmp|class|divx|doc|docx|eot|exe|gif|gz|gzip|ico|jpg|jpeg|jpe|json|mdb|mid|midi|mov|qt|mp3|m4a|mp4|m4v|mpeg|mpg|mpe|mpp|otf|odb|odc|odf|odg|odp|ods|odt|ogg|pdf|png|pot|pps|ppt|pptx|ra|ram|svg|svgz|swf|tar|tif|tiff|ttf|ttc|wav|wma|wri|xla|xls|xlsx|xlt|xlw|zip)$ [NC]
RewriteRule .* – [L]
</IfModule>

.htaccess file

# BEGIN W3TC Skip 404 error handling by WordPress for static files
<IfModule mod_rewrite.c>
RewriteEngine On
RewriteCond %{REQUEST_FILENAME} !-f
RewriteCond %{REQUEST_FILENAME} !-d
RewriteCond %{REQUEST_URI} !(robots\.txt|sitemap(_index)?\.xml(\.gz)?|[a-z0-9_\-]+-sitemap([0-9]+)?\.xml(\.gz)?)
RewriteCond %{REQUEST_FILENAME} \.(css|htc|js|js2|js3|js4|html|htm|rtf|rtx|svg|svgz|txt|xsd|xsl|xml|asf|asx|wax|wmv|wmx|avi|bmp|class|divx|doc|docx|eot|exe|gif|gz|gzip|ico|jpg|jpeg|jpe|json|mdb|mid|midi|mov|qt|mp3|m4a|mp4|m4v|mpeg|mpg|mpe|mpp|otf|odb|odc|odf|odg|odp|ods|odt|ogg|pdf|png|pot|pps|ppt|pptx|ra|ram|svg|svgz|swf|tar|tif|tiff|ttf|ttc|wav|wma|wri|xla|xls|xlsx|xlt|xlw|zip)$ [NC]
RewriteRule .* – [L]
</IfModule>
# END W3TC Skip 404 error handling by WordPress for static files
# BEGIN WordPress

toolsqa, if you deactivate W3 Total Cache, does it work then (with 4.0.1)?

when i deactivate the w3cache plugin , those entry are still in my htaccess file, do i need to remove them also manually?

Yes, please try to remove them manually. Would it be possible that I can check the problem directly on your blog? Please email me at himself …. arnebrachhold … de