robots.txt file hidden

  • Resolved Swayze

    (@shelbyswayze)


    8 years, 7 months ago

    On my site https://www.lingolconstruction.com/ (I’m webmaster not owner) I put in a robots.txt file which is empty as recommended by others but when I do a check with a robots file checker https://tool.motoricerca.info/robots-checker.phtml
    I find that there is another robots.txt file which shows the following:

    ‘Line 1 User-agent: *
    Line 2 Disallow: /wp-admin/
    Line 3 Allow: /wp-admin/admin-ajax.php
    Unknown command. Acceptable commands are “User-agent” and “Disallow”.
    A robots.txt file doesn’t say what files/directories you can allow but just what you can disallow.’

    My question is: how do I find that file so I can eliminate or empty the contents.

    Thanks

Viewing 9 replies - 16 through 24 (of 24 total)
  • Thread Starter Swayze

    (@shelbyswayze)

    I don’t know where that root file name came from. I inherited this website 4 or 5 years ago when I knew nothing about wordpress. Now I’ve had 2 simple wordpress online classes but I’m still somewhat lost with all these files. I understand HTML (I have my own site with only a wordpress blog).

    Thread Starter Swayze

    (@shelbyswayze)

    I think I’ll reactivate my Yoast plugin to see if the test you gave me:
    https://www.lingolconstruction.com/robots.txt changes.

    Thread Starter Swayze

    (@shelbyswayze)

    Nope; with the activation the results is the same:

    ‘
    User-agent: *
    Disallow: /wp-admin/
    Allow: /wp-admin/admin-ajax.php
    ‘

    Thread Starter Swayze

    (@shelbyswayze)

    This seems to be a key to the puzzle. The following is a report.

    The following block of code contains some errors. Please, remove all the reported errors and check again this robots.txt file.
    Line 1 User-agent: *
    Line 2 Disallow: /wp-admin/
    Line 3 Allow: /wp-admin/admin-ajax.php
    Unknown command. Acceptable commands are “User-agent” and “Disallow”.
    A robots.txt file doesn’t say what files/directories you can allow but just what you can disallow.

    Shelby:
    So the source (https://tool.motoricerca.info/robots-checker.phtml) seems to say that the file’s Allow attribute is crap.

    Thread Starter Swayze

    (@shelbyswayze)

    It seems as though the allusive self generated wordpress virtual robots file is being programmed to fire using improper syntax.

    i.e. allow……………..

    It seems as though the allusive self generated wordpress virtual robots file is being programmed to fire using improper syntax.

    Yeah… but no. Here is why.

    https://core.trac.www.ads-software.com/ticket/33156
    https://www.seroundtable.com/google-warning-googlebot-css-js-20665.html

    This is simple.

    Is there, or is there not, a file named “robots.txt” which you created in dreamweaver, currently located in the /public_html directory on the website?

    Thread Starter Swayze

    (@shelbyswayze)

    No, shall I try to upload it to that folder?

    Thread Starter Swayze

    (@shelbyswayze)

    Looks like that has done the trick Clayton. I put in the file with the text you gave me earlier but then decided to try the blank file before I ran a check. Finally after months of torture I may have my answer. Now I’ll see if in a few days I start getting some ranking returning to search engine results. I thank you for the time and effort analyizing this for me. If it remains functional as I hope, where do I send the check?

    It’s all good! Glad you got to the bottom of it. ??

Viewing 9 replies - 16 through 24 (of 24 total)
  • The topic ‘robots.txt file hidden’ is closed to new replies.