Robots.txt not working

  • Hello,

    in the area Seo I try to create the Robots.txt. Unfortunately, this does not seem to work. No matter if I create the robots.txt in advance with Yoast or not. Either it is not available or generated by Yoast!

    Greeting

    • This topic was modified 6 years, 6 months ago by guennionline.
Viewing 2 replies - 1 through 2 (of 2 total)
  • Thread Starter guennionline

    (@guennionline)

    I also deleted the existing robots.txt and tried to recreate it. This too does not work!

    Plugin Author webcraftic

    (@webcraftic)

    Hi,

    In Clearfy is this a virtual robot file, it does not have to be in your directory. But when you access https://mysite.dev/robots.txt, this page is available.

    1. Remove your robot file from the root directory of the site
    2. Activate the robot option in the settings Clearfy
    3. Go to https://yoursite.dev/robots.txt

    Try to disable SEO plugins to check whether the robot page is generated. Perhaps the plugins are conflicting because of similar functions.

    Best regards, Alex

Viewing 2 replies - 1 through 2 (of 2 total)
  • The topic ‘Robots.txt not working’ is closed to new replies.

Tags