• Resolved ronny84

    (@ronny84)


    Hi there,

    I have seen at google search console that google has an problem with the robots.txt rules.

    “Disallow: /wp-content/uploads/wpo-plugins-tables-list.json

    No user-agent specified”

    The problem comes on several websites I host. This seems to be an problem of WP Optimize. I have seen that 1 year ago there were topics on this, but I have seen no issue.

    How the fix the problem?

    Thank you.

    Kind Regards

    The page I need help with: [log in to see the link]

Viewing 4 replies - 1 through 4 (of 4 total)
  • Plugin Contributor Venkat Raj

    (@webulous)

    @ronny84

    If No user-agent specified is the issue you are mentioning, the WP Optimize only adds Disallow: /wp-content/uploads/wpo-plugins-tables-list.json to existing robots.txt

    It doesn’t create robots.txt file, it only adds single line to existing file. So, you have to look which SEO plugin creates that file and why it hasn’t specified any user agent, etc

    Thread Starter ronny84

    (@ronny84)

    Hi,

    I think its no other plugin. I have only a few and none of them does something with the robots.txt.

    By the way: I asked some other people. They told me the code is wrong. That must look like Disallow: * /wp-content/uploads/wpo-plugins-tables-list.json

    Could you please check your plugin?

    Kind Regards

    Plugin Contributor Venkat Raj

    (@webulous)

    @ronny84

    The rule is as per guidelines
    https://developers.google.com/search/docs/crawling-indexing/robots/create-robots-txt

    To debug the issue…
    1. Disable all plugins.
    2. Delete robots.txt
    3. Enable WP Optimize

    You won’t see robots.txt file.
    4. Enable other plugins one by one and you’ll find which plugin creates robots.txt

    As I said in my earlier reply, WP Optimize only added one line when robots.txt exists

    I have the same problem, I read in another thread that we should add:
    add_filter( ‘wpo_update_plugin_json’, ‘__return_false’ );

    But I don′t know where?
    I put it like this and that second line is not working. I do not know about coding.

    Disallow: /wp-content/uploads/wpo-plugins-tables-list.json
    add_filter( ‘wpo_update_plugin_json’, ‘__return_false’ );

    Is it true that despite some of this information already being publicly available, providing a file like this is just inviting brute force campaigns? I am having plenty of haking attemps daily.

Viewing 4 replies - 1 through 4 (of 4 total)
  • The topic ‘Robots.txt problem with GSC’ is closed to new replies.