Missing robots tag across the site

  • Resolved Abhijeet K

    (@abhijeet41)


    7 years, 2 months ago

    Hello,

    Greetings of the day!

    I have been facing an issue after updating the Yoast SEO plugin to latest version 5.4.2.
    The issue is:

    There used to be <meta name=”robots” content=”index, doodp”/> across the pages as defined in the setting of the plugin from Title & Metas section. Now that tag is no longer showing up at the front end on any of the pages.

    Even tried the same by enabling FourtyFifteen theme of wordpress, but no luck ??

    I am also suspecting that it could be the reason for which Google is not indexing my site on a frequent interval as before

    Please help me out.

    Thanks,
    ABHIJEET

Viewing 7 replies - 1 through 7 (of 7 total)
  • Thread Starter Abhijeet K

    (@abhijeet41)

    For a reference here is one of the URLs

    https://abhijeetkarmakar.com/remote-files-transfer-from-one-server-to-other/

    Please check in the source code. The robots meta tag used to be there right after the description meta tag

    Ref screen-shot with the pointing in the source where I saw that tag before: https://prntscr.com/goo91k

    Plugin Support Md Mazedul Islam Khan

    (@mazedulislamkhan)

    The noodp robots meta has been removed from the Yoast SEO v4.9 as DMOZ no longer exist. Please, refer to the relevant GitHub issue here to learn more about this.

    Thread Starter Abhijeet K

    (@abhijeet41)

    Thanks for your response.

    I have gone through the Git issue thread and its fine that noodp in robots meta is no longer required. But how come the robots meta tag itself gone vanished from the page?

    Please help getting that back.

    Also, please tell me whether I’m right or wrong, If the robots meta tag doesn’t exist on a page, isn’t it going to hurt SEO performance somehow?

    Thanks in advance for your help and time resolving this.

    Hi –

    Abhijeet is the developer for my site, https://www.cardboardconnection.com and we are having the same issue there as his aforementioned blog.

    The Yoast SEO plugin is no longer including the robots meta TAG at all, nor is it displaying any robots meta tag values that we have set through yoast.

    None of the sitewide robots meta tag values which I have set under the “Titles & Metas – Yoast SEO” setting page(s) are being displayed. Additionally the individual exceptions set in the Yoast SEO page/post/custom post and category/custom taxonomy specific editor (for example, we have a custom taxonomy called ‘brand’ that we have set the site wide defaul to noindex, follow but have a number of the terms such as this https://www.cardboardconnection.com/brand/topps-cards/bowman-chrome-baseball that are individually set to index,follow in the term editor page.

    We have used the Yoast’s SEO plugin for years and just recently started experiencing this issue – we believe it started in the last couple of weeks but it didn’t come to our attention until a couple of days ago when I received a Google indexing notification and had some unusual traffic fluctuations and found that their was no longer a robot meta tag being displayed at all for any post/taxonomy/archive/url of the site.

    My developer has added some code to the functions.php file of our theme that outputs the robot meta tag with values noindex,follow fot the ‘brand’ custom taxonomy and index,follow as the site wide default for other taxonomies and posts/pages as a temporary solution but since it is not being output by the Yoast SEO plugin, none of the individual exceptions we have set on a term by term custom post type/page basis are showing up at all.

    Please advise asap as we would like to get this resolved as quickly as possible. Additionally I am purchasing a premium subscription for the plugin if that is relevant but have not updated or used it on the site yet.

    index,follow is the default meta robots setting, thus there’s no need to explicitly add it to the source code of your pages. If you don’t see a robots meta tag on your pages, then search engines will consider that your pages are to index,follow . That’s why Yoast SEO doesn’t generate the robots meta tag when you’ve selected index,follow in the plugin. Please, refer to this KB article for more information: https://kb.yoast.com/kb/dont-see-index-follow-in-meta-robots-tag/

    @msmeth As you have a premium subscription, would you mind contacting personal support if you still experience any problems with the robots meta tag? Our support team will look at your site and help you further.

    Plugin Support Jerlyn

    (@jerparx)

    Closed due to inactivity.

    Andi Lee Davis

    (@andi-lee-davis)

    Yeah we got this, the default outputs nothing but causes the error:

    We have detected the following issues that affect the SEO of your site.

    Your homepage cannot be indexed by search engines. This is very bad for SEO and should be fixed.

    The site has no crawl errors, but I still have had a hard time trying to explain this to our client. Everytime I try to re-fetch it shows this error, whilst some websites do not have this issue.

    Can you ask Ryte (formally OnPage.org) to stop reporting this on pages without metas or indexable pages as set out by your plugin.

    Best Regards,

    Andi

Viewing 7 replies - 1 through 7 (of 7 total)
  • The topic ‘Missing robots tag across the site’ is closed to new replies.