effects on robots

  • Resolved Deon

    (@deon-b)


    4 years, 3 months ago

    Hi,
    I am using your plugin on a domain where I set the robots file as: 

    User-agent: *
Disallow: /

    But when I visit the domain /robots.txt page I see the “coming soon” page.

    And when I test the robots file using online tools I get this: (allowed)
    https://pasteboard.co/Jm36EM4.png
    https://pasteboard.co/Jm36UAT.png

    If instead I disable your plugin, and re-do the test: I get (disallowed).
    Is it possible your plugin is interfering with the robots.txt file?

Viewing 9 replies - 1 through 9 (of 9 total)
  • Plugin Support franz1989

    (@franz1989)

    @deon-b Not that we know. Possible a caching issue. Make sure to delete site/browser cache for the changes to take effect on yuor end. This is what we advise should you want not to index your Coming Soon page.

    For Google indexing, should you want Google not to index your staging URL, you can create a robots.txt file as described here: https://www.wpbeginner.com/wp-tutorials/how-to-optimize-your-wordpress-robots-txt-for-seo/ and add this to prevent search engine from indexing your staging site: https://share.getcloudapp.com/BlupwP95

    Nad the links provided does not work. It throws 500 error.

    Thread Starter Deon

    (@deon-b)

    Hi,
    if you see in my OP I have written the exact same robots that you recommend me.

    Note that I have this website and this robots file for 7 years and I installed your plugin 6-7 years ago. So this is not a new thing.

    Google had not indexed anything from this website in years, everything went perfect, but then it started indexing things a few months ago, I think after I updated wordpress or when I changed host, at that time probably something changed and the robots file is probably being ignored?

    I don’t know but when I check with some robots file testers they give me a strange result like for the screenshots in my OP.

    When I click on the links in my OP I can see the screenshots, I dont know why you get a 500 error, but here they are again.

    https://ibb.co/WppfXfT
    https://ibb.co/fDvrvVz

    Plugin Support franz1989

    (@franz1989)

    @deon-b To verify, are you using the SeedProd Coming Soon plugin? In this screenshot: https://ibb.co/fDvrvVz

    It says you are using the Ultimate Coming Soon page. This is a different plugin.

    Thread Starter Deon

    (@deon-b)

    I saw it was a coming soon plugin by seedprod
    https://ibb.co/0fFMvZs

    You sold it?

    Plugin Support franz1989

    (@franz1989)

    @deon-b That is our super old free version. This is now our free version: https://www.ads-software.com/plugins/coming-soon/

    Thread Starter Deon

    (@deon-b)

    Hi,
    ok I didn’t see an “update” button so I never updated it.

    Anyway, I am trying now your new plugin, but I get the same result:
    https://ibb.co/RpTJz4V

    Although I have this robots:

    User-agent: *
Disallow: /

    It shows: allowed as from screenshot

    Plugin Support franz1989

    (@franz1989)

    @deon-b The robots.txt is not accessible. You need to manually upload a robots.txt then it should be recognized. If you are using a plugin to create it then it may be blocked since the URL would be virtual.

    In our Pro version, you can exclude the URL so it will not show the Coming Soon page. The exclude/include feature is not available in the Free version.

    • This reply was modified 4 years, 3 months ago by franz1989.
    Thread Starter Deon

    (@deon-b)

    Hi,
    I didn’t want to post my URL because I don’t want links to it online for search engines to crawl.

    May I please ask you to remove the URL from your previous message?
    And yes I was using a plugin for the robots.

    • This reply was modified 4 years, 3 months ago by Deon.
    Plugin Support franz1989

    (@franz1989)

    @deon-b I have removed it. You need to manually upload the robotz.txt file for it to be recognized.

Viewing 9 replies - 1 through 9 (of 9 total)
  • The topic ‘effects on robots’ is closed to new replies.