Robots.txt

  • Resolved samclark008

    (@samclark008)


    7 years, 12 months ago

    Hi there,

    currently the robots.txt file works from the following location: https://’domain’.co.uk/sitemap.xml

    However, I am concerned that the other variations of my site that may be picked up by the robots will therefore miss the sitemap.
    The other variations are: https://’domain’.com/sitemap.xml; https://www.’domain’.co.uk/sitemap.xml; https://www.’domain’.com/sitemap.xml.

    Admittedly I do not know how the robots.txt file works at the moment but if I type in any other variation into the web address bar it draws up a blank page so this is something of a concern to me. How can you best advise to ensure all variations of my domain/site is covered so that it may be picked up? Note I have also registered the sitemap with Bing and Google as well as ensuring there is a HTML sitemap on the site but I want to make sure that I have covered every basis possible.

    Any advice you could offer would be greatly appreciated.

    Thanking you in advance,

Viewing 2 replies - 1 through 2 (of 2 total)
  • Michael Torbert

    (@hallsofmontezuma)

    WordPress Virtuoso

    To have any idea I’d need more information. By what method are you creating different versions? Are they different WP installations? One installation and htaccess redirects? One installation and a plugin like WPML?

    Thread Starter samclark008

    (@samclark008)

    Hi Michael, thanks for your prompt response.

    It is one installation. The different variations are through my host site. However, the only redirect I ever instructed was that of the .com version (without the www. it seems)- which apparently is under an alias (I don’t know if that means anything to you). How the redirect for the www. versions of .com and .co.uk occurs I am unsure- I know that sounds odd when I own it but I am only just coming across this now. It seems that the .co.uk without the www. prefix is the dominant site (.com without the www. is the secondary). Hope that helps and I am sorry to be so vague.

Viewing 2 replies - 1 through 2 (of 2 total)
  • The topic ‘Robots.txt’ is closed to new replies.