crawling question

  • Resolved andrew55

    (@andrew55)


    6 years, 3 months ago

    I have 3 WordPress installations on the same domain. Rather than using a per-site sitemap generator, I have script which creates a sitemap for all wp installations on the domain (in one sitemap).

    In LiteSpeed Crawler Settings, what configuration would you suggest? Is it OK to enter the single domain sitemap in the Custom Sitemap field for each of our WordPress installations? I was concerned about doing this because in this sitemap, there will be pages that are not inside each site. For example, if our site is setup like this:

    mysite.com
    mysite.com/community

    …and we are using LiteSpeed in both wp installations, if I include the domain sitemap in the settings of mysite.com, there will be pages from mysite.com/commuity which exists in the mysite.com sitemap, but which are not accessible to mysite.com.

    Thank you for any suggestions.

Viewing 8 replies - 1 through 8 (of 8 total)
  • Plugin Support qtwrk

    (@qtwrk)

    Hi,

    I think it would be better to set them up individually on each site.

    Best regards

    Hi @andrew55, we suggest each site have their own sitemap.

    Using the same sitemap should not cause an error but might hit the page which already crawled or hit some page didn’t exist, which mean it is using more computing power, storage and time when you running the crawler.

    Thread Starter andrew55

    (@andrew55)

    Thank you for the replies. Are you folks suggesting I do away with my current “whole site” sitemap script and use LiteSpeed only to set up separate site maps for each site (on this on domain)?

    If so, I’m concerned search engines might see these as different sites (when it’s really one big site).

    Or, is is OK to keep my existing sitemap and also use the LiteSpeed sitemaps? Are these sitemaps generated by LiteSpeed for LiteSpeed purposes only, or are they for search engine use also?

    Thanks for any clarification/suggestions.

    Hi @andrwe55, you can go to

    LiteSpeed Cache > Settings > Crawler > Custom Sitemap

    to set the single site sitemap just for LiteSpeed Cache Crawler use.

    Thread Starter andrew55

    (@andrew55)

    Just to clarify – are you suggesting I set up these custom sitemaps with LiteSpeed and also keep my existing whole-site sitemap?

    And just to be safe, will setting up separate custom sitemaps only for LiteSpeed Cache Crawler use counteract the benefits of my existing sitemap (set up for searching engines)?

    I just want to keep things correct for search engines. Thanks.

    Plugin Support LiteSpeed Lisa

    (@lclarke)

    Hi, Andrew

    If you let LiteSpeed generate a custom sitemap, it is only used by LiteSpeed. You can still submit your original whole-site sitemap to Google and other search engines if you like.

    Hope this clarifies it!

    Thread Starter andrew55

    (@andrew55)

    Perfect. Thank you very much for the clarification.

    Plugin Support LiteSpeed Lisa

    (@lclarke)

    My pleasure. Happy crawling! ??

Viewing 8 replies - 1 through 8 (of 8 total)
  • The topic ‘crawling question’ is closed to new replies.

Tags