robots settings not working

  • Resolved Starhorsepax2

    (@starhorsepax2)


    8 years, 5 months ago

    Yoast is no longer reading / allowing the allow indexing setting to be changed from the settings page.

    The robots.txt that is created in development mode has disallow / – which I would expect when I have it not allowed in settings. But when I switch it to ‘allow’ in the settings, the robots.txt created by Yoast is not being updated. It continues blocking.

    This is a brand new site and definitely has no other robots.txt in it. It’s the second time I’ve noticed it. Why is Yoast not updating based on the wordpress settings box?

    Is it POSSIBLE Wordfence new firewall is conflicting with Yoast now? I do not see any settings in the firewall that should block robots however.

    https://www.ads-software.com/plugins/wordpress-seo/

Viewing 3 replies - 1 through 3 (of 3 total)

  • I have a site that also isn’t registering my edits to robots.txt through Yoast. The File editor has saved my changes but has not published the updates to the robots page.

    Have you checked the file permissions (CHMOD) to make sure that the file is writeable? Make sure it is at least 0644.

    Thread Starter Starhorsepax2

    (@starhorsepax2)

    That was the first thing I checked. It saves anything you type into it. What it doesn’t save is the wordpress setting: the default one on the ‘read’ page of settings that says allow robots indexing or not. I’m quite sure that worked fine before at matching that setting. Now whatever it is setting on when the file was created, that is what it keeps no matter how many times you check, uncheck, save etc.

Viewing 3 replies - 1 through 3 (of 3 total)
  • The topic ‘robots settings not working’ is closed to new replies.