A description for this result is not available because of this site's robots.txt

The link you specified is a xml file. You can see that the format is valid if you try the link you provided here: https://www.xml-sitemaps.com

Now, your site may also contain a human readable sitemap structured in html. Those are not be confused. xml sitemaps are for machines to read, while html sitemaps are for people to read. Make sure you are specifying the specific url file link you posted above when you submit to Google.

Now, the robots.txt file is basically a gatekeeper. If a search engine comes looking for the site to index, via an organic find or a xml sitemap submission, the robots.txt file tells the search engine if it welcome to check out the site, and what stuff on the site it’s allowed to look at for indexing purposes. Your host may have created a highly restrictive version for you. Using your host’s control panel (cPanel) or FTP Access, check the root folder of your site. If the file exists, delete it. Then, you can use Yoast’s SEO plugin to create one the way you want it.

It means your robot.txt file has disallow the particular page google has indexed but the header has no meta tag noindex which is what would prevent it from getting indexed in the first place.

Basically the robot.txt disable any information from being taken from the page but the lack of the noindex tag allowed it to show up in the search.

Either you remove it from being disallowed form the robot file or just noindex the webpage as well so its not indexed either way.

It will take a few months before your changes reflact in google search

I’m dealing with sort of a similar issue https://www.ads-software.com/support/topic/how-to-noindex-categories-and-archives?replies=1

Hmm, I deleted my robots.txt and made a new one. For some reason it still is giving me the

A description for this result is not available because of this site’s robots.txt – learn more.

error. Anything else I should try?

As clouder said, it will take a while for your changes to be reflected in Google. You will need to wait for Google to reindex your site. You can try pushing Google to do it sooner by following the instruction here: https://support.google.com/webmasters/answer/1352276

Thank you!

Hello, I’m having a similar problem.
My website used to come up first thing in Google search when I typed my name into the search window and clicked ‘search’. Suddenly, it doesn’t come up anymore when I google my name. Not on the first page OR on any of the following pages. If I type my weblink directly into the search window, it comes up, but the following sentence is added behind it:
“A description for this result is not available because of this site’s robots.txt”

Why does my website not come up anymore when I google my name? Does that have to do with the robots file?

I logged into my server via the FETCH software and went to the roots folder, but there was no robots file, so I couldn’t delete it.

Is this a Google problem? Or a server problem? Or a WordPress problem??

I’m going nuts and would appreciate your advice…

@watermelon888
I supspect it may be a Google issue. They are always tweeking their algorithm and making changes.

I have problem like this, My website suddenly in trouble like this, I’ve never sent sitemap again since making the website and I only promote content available on the website. What is the solution?
Requested aid to the understanding in this matter.
Thank you!
https://semerupetir.com Keyword if you search on google is “Pasang Penangkal Petir” On Page 3 Will appear “A description for this result is not available because of this site’s robots.txt” on description.

@sxanyar. here is your robots.txt > https://semerupetir.com/robots.txt

User-agent: *

Disallow: /

User-agent: Googlebot-Image

Disallow: /

– that means no crawls for the whole site. Delete your existing robots.txt file and generate a new one. You may use yoast seo plugin to come up a new robots.txt file.