• Resolved rj2021

    (@rj2021)


    My content pages (user profiles) are not being indexed by Google and the source code shows:

    <!– The SEO Framework by Sybre Waaijer –>
    <meta name=”robots” content=”noindex,max-snippet:-1,max-image-preview:standard,max-video-preview:-1″ />

    My robots.txt is:

    User-Agent: *
    Disallow: /cgi-bin
    Disallow: /message
    Disallow: /register
    Disallow: /slides
    Disallow: /wp-
    Disallow: /?s=
    Disallow: *&s=
    Disallow: /search
    Allow: /author/
    Disallow: *?attachment_id=
    Disallow: */feed
    Disallow: */rss
    Disallow: */embed
    Allow: /wp-content/uploads/
    Allow: /wp-content/themes/
    Allow: /*/*.js
    Allow: /*/*.css
    Allow: /wp-*.png
    Disallow: /wp-admin/
    Allow: /wp-admin/admin-ajax.php
    Allow: /wp-*.jpg
    Allow: /wp-*.jpeg
    Allow: /wp-*.gif
    Allow: /wp-*.svg
    Allow: /wp-*.pdf
    Sitemap: https:/www.mysitename/sitemap.xml
    Sitemap: https://www.mysitename/sitemap.html

    I have checked all the settings I can change, and nothing is marked as noindex so I am not sure where this is produced from. The pages affected aren’t classed as “pages” or “posts” by the theme I use.

    Any suggestions please ?

Viewing 10 replies - 1 through 10 (of 10 total)
  • Plugin Author Sybre Waaijer

    (@cybr)

    Hello!

    TSF can force noindex on Author pages via “SEO Settings > Robots Meta Settings > Indexing > Global Settings > Apple noindex to Author pages?”. I assume you’ve already found this toggle and unchecked it.

    Also, when authors have no posts published, their profiles are deindexed automatically. You can disable this protective feature by adding this filter to your site:

    add_filter( 'the_seo_framework_robots_meta_array', function( $meta, $args, $ignore ) {
    
    	if ( null === $args ) {
    		if ( is_author() ) {
    			unset( $meta['noindex'] );
    		}
    	}
    
    	return $meta;
    }, 10, 3 );
    Thread Starter rj2021

    (@rj2021)

    Thanks for the fast response !

    Where should I use this code ? I have quickly tried adding it with a code snippets plugin, but that gives the following error:

    The code snippet you are trying to save produced a fatal error on line 275:

    set_time_limit(): Cannot set max execution time limit due to system policy
    The previous version of the snippet is unchanged, and the rest of this site should be functioning normally as before.

    Please use the back button in your browser to return to the previous page and try to fix the code error. If you prefer, you can close this page and discard the changes you just made. No changes will be made to this site.

    Plugin Author Sybre Waaijer

    (@cybr)

    That’d be a bug in the code snippets plugin you used. The snippet I posted has no relation to set_time_limit()

    Here you can learn where to place custom snippets best:
    https://theseoframework.com/docs/using-filters/#where

    Thread Starter rj2021

    (@rj2021)

    I have used another snippets plugin and that seems to work without errors (thanks for the help) but the pages are still showing the same noindex in source code and when inspected by Google :

    Crawl
    Time
    Nov 22, 2020, 12:08:24 PM
    Crawled as
    Googlebot smartphone
    Crawl allowed?
    Yes
    Page fetch
    Successful
    Indexing allowed?
    No: ‘noindex’ detected in ‘robots’ meta tag

    Do I need to be a bit more patient to let this work, or am I missing something ?

    Thread Starter rj2021

    (@rj2021)

    Any further suggestions ?

    Plugin Author Sybre Waaijer

    (@cybr)

    Hello!

    I’m not sure if I can help any further: I’d need a link to your website — that’d save me a lot of time guessing and writing out info that might not apply to you! ??

    1. If you use a caching plugin, you may need to clear its caches for the snippet to become effective.
    2. It can take some time for search engines to process changes. You can ask Google to recrawl a URL to see if your changes are working instantly.
    3. It might be possible that the snippet you implemented isn’t active (in time) on the author pages, but I don’t know which plugin you used to verify this plausibility.

    I hope this helps! Cheers ??

    Thread Starter rj2021

    (@rj2021)

    Thanks for the response again.

    – I do use W3 total cache, but have cleared all caches several times with no difference

    – I have used the Google tool, and it still shows noindex on these pages

    – The plugin I used is PHP code snippet, it seems to have been accepted (no error messages anyway?

    Do you want me to email you some screenshots and site details ?

    I appreciate your help with this – if this plugin wasn’t so incredibly useful (and simple to use) I would have already deleted it and tried something else !

    Plugin Author Sybre Waaijer

    (@cybr)

    Hi again!

    Yes, feel free to contact me confidentially via our contact form. https://tsf.fyi/contact

    Thread Starter rj2021

    (@rj2021)

    Thank you for the fast response to the contact form.
    The issue is now resolved with the snippet you provided earlier.

    Oddly the snippet plugin you suggested was the one I used originally which threw up the error message, but now works !

    Excellent support, especially considering this is a free plugin !

    Plugin Author Sybre Waaijer

    (@cybr)

    Cheers! I’m glad it all worked out ??

    And thank you for the kind review ?? Have a nice day!

Viewing 10 replies - 1 through 10 (of 10 total)
  • The topic ‘noindex issue’ is closed to new replies.