Bingbot only pulls English version despite /zh/ being specified. Googlebot OK.

  • Resolved ngcheewe

    (@ngcheewe)


    5 years ago

    I am having difficulty having my Chinese site /zh/ indexed by Bing (and also Baidu) but Google is perfectly indexed.

    I believe it’s because Bingbot (and Baidu) pulls the English version when it goes to my /zh/ site. I know this is happening because in Bing’s Webmaster Tool>>Diagnostics & Tools>>Fetch as Bingbot, my /zh/ site returns en-US and English site, not the Chinese. I also went to https://technicalseo.com/tools/fetch-render/ to pull my /zh/ site, and if I specified Bingbot, it pulls English version. But if I specified Google, it actually pulls Chinese correctly. Loading /zh/ site in any browser returns Chinese site, also in a mobile app like View Source.

    I have written to Weglot support. They don’t know why my Chinese site is not being indexed. They claim that https://www.weglot.com/fr/ is correctly indexed in Bing, even though if you tried https://technicalseo.com/tools/fetch-render/ and specified Bingbot to pull https://www.weglot.com/fr/, it actually returns their English site instead of French too. I wonder if there are other reasons why Bing is able to index French version of https://www.weglot.com/fr/

    Does anyone know the differences between Bing/Bingbot versus Google/Googlebot or a normal browser that could result in WordPress/Weglot always returning the English site to Bingbot?

    Clearly Bingbot is communicating with WordPress/Weglot in a way that causes English version to be pulled, and this is different than any browser or Google.

    Thank you!

    • This topic was modified 5 years ago by ngcheewe.

    The page I need help with: [log in to see the link]

Viewing 2 replies - 1 through 2 (of 2 total)
  • Plugin Author Remy B

    (@remyb92)

    Hey, Remy here the developer. Ok I changed an internal setting, can you check now ? It should be working

    Thread Starter ngcheewe

    (@ngcheewe)

    Thank you Remy for the quick response.

    I confirmed after you changed the setting that Bing Webmaster Tool was able to pull the Chinese site. After waiting one day, Bing has indexed my site.

    Still waiting for Baidu to do the same.

    Thank you. Please keep this internal setting and do not change it!

Viewing 2 replies - 1 through 2 (of 2 total)
  • The topic ‘Bingbot only pulls English version despite /zh/ being specified. Googlebot OK.’ is closed to new replies.