default wordpress robots or yoast robots which is better

Hello Elena,

Thanks for reaching out about your robots.txt file. Just to clarify what you described, do you mean you see a robots.txt on your server?

If yes, is the content different from what you see in https://www.example.com/robots.txt?

yes its correct robots.txt show from virtual WP robots.txt what automatic create but file what have on server robots.txt https://prnt.sc/krLthe8IP7KA didn’t show at all so I don’t know what to do to redirect on robots.txt this file https://prnt.sc/krLthe8IP7KA ( what also coming from Yoast )

right now its show different content from virtual robots.txt not even on cPanel

so on your question:

If yes, is the content different from what you see in?https://www.example.com/robots.txt?

yes content different ( its coming not from Yoast or robots.txt file its coming from virtual robots.txt create by WP )

also:

have two robots.txt urls

with www. and without same content from virtual robots.txt WP

should I add redirect to htaccess? I don’t know if its good for index Google with redirect……

Redirect 301 https://example.com/ robots-virtual wp https://example.com robots from Yoast and from cpanel file

• This reply was modified 1 year ago by Elena2021.

Can you share a screenshot of the contents of the one in the Yoast SEO plugin?

here: https://prnt.sc/73-6a62Yatgm

You can delete the physical robots.txt file you have on your server. Next, ensure that the contents of the robots.txt file created with Yoast SEO meets these guidelines.

I did like you suggest, totally remove file robots.txt

but now its show this code on dashboard admin: https://prnt.sc/9YAwXPAEMpaB

START YOAST BLOCK —————————

User-agent: *
Disallow:

Sitemap: https://www.example.com/sitemap_index.xml ————————— END YOAST BLOCK

Not like this: https://prnt.sc/U2t3KsyW6GXJ

plus virtual robots.txt from WP still on server..

after I create robots from Yoast on cPanel show new file robots.txt where show content from Yoast just like it was show content before I remove old file.

and still when I look my website: https://www.example.com/robots.txt its same show Virtual code robots.txt

User-agent: *

Disallow: /wp-admin/

Allow: /wp-admin/admin-ajax.php

Sitemap: https://www.example.com/sitemap_index.xml

just like I ask before:

when I look my robots in https://www.example.com/robots.txt its show default robots from WP ( I don’t see file robots.txt on server )

I do use Yoast plugin and in tools>edit files I do have robots.txt and I do see it on my server file from Yoast but on https://www.example.com/robots.txt its point to default WP robots.txt

I do have questions:

1. what better for SEO robots.txt from default WP ( I don’t see it on server ) or from Yoast plugin with with robots.txt in directory ?
2. how I can disable default robots.txt so this link https://www.example.com/robots.txt point only on Yoast robots.txt and works correct for SEO thank you for any help

I have to add redirect on htaccess so looks like its now point on file from Yoast robots.txt hope ts works

To answer your questions:

what better for SEO robots.txt from default WP ( I don’t see it on server ) or from Yoast plugin with with robots.txt in directory ?

This is what your robots.txt file should look like: https://prnt.sc/9YAwXPAEMpaB

how I can disable default robots.txt so this link?https://www.example.com/robots.txt?point only on Yoast robots.txt and works correct for SEO thank you for any help

Delete what you have on your server. Then proceed to Yoast SEO > Tools > File Editor and create a robots.txt file. The contents will be in this format: https://pasteboard.co/en5dAjYzKZsb.png

thanks for your answer

so this format Not correct:

User-agent: *

Disallow: /wp-admin/

Allow: /wp-admin/admin-ajax.php

Sitemap: https://www.example.com/sitemap_index.xml

why this format should be: https://prnt.sc/9YAwXPAEMpaB

why it have to be:

START YOAST BLOCK

END YOAST BLOCK

its not blocked from Google index?

why you not use https://yoast.com/robots.txt

START YOAST BLOCK

END YOAST BLOCK

I also read your article https://yoast.com/help/how-to-edit-robots-txt-through-yoast-seo/ its Not show

START YOAST BLOCK

END YOAST BLOCK

We do not recommend using the format of our website’s robots.txt as we sometimes use it to test new directives.

This is what your robots.txt file should look like:?https://prnt.sc/9YAwXPAEMpaB

ok thank you