Ressource blocked by Amazon robots.txt

  • Hi,
    Looking at Google Console this morning I found out that the all the iframe ressources have been blocked a few days ago by Amazon.fr robots.txt file.
    Everything was working great until March 19.
    I don’t want my rankings to be impacted because of this.
    Does someone know about this ?
    Thanks

Viewing 3 replies - 1 through 3 (of 3 total)
  • Thread Starter juliengandelin

    (@juliengandelin)

    Same thing for amazon.com : check their robots.txt file : https://www.amazon.com/robots.txt

    They disallow : Disallow: /reviews/iframe

    Plugin Author jhanbackjr

    (@jhanbackjr)

    Hi, @juliengandelin.

    Thanks for using ScrapeAZon. As far as I can tell, Amazon.com’s Product Advertising API is still delivering reviews by using an iFrame source URL. The reviews still work on my test sites flawlessly.

    The robots.txt file you linked to disallows a user-agent value of /reviews/iframe. Nothing in ScrapeAZon changes the user agent value that is sent to Amazon’s servers when the reviews are retrieved from Amazon. If you’re experiencing problems retrieving data from Amazon.fr, you might verify the user agent value in the browser you’re using.

    Thanks for using ScrapeAZon and let me know if I can be of further assistance troubleshooting this.

    James

    Thread Starter juliengandelin

    (@juliengandelin)

    Hi,
    Thanks for your fast answer. I still have reviews working on my website, I am just concerned that Google penalizes my ranking because they cannot read the entire content of my pages. And in my Google Console I got a red message saying something like “…if GoogleBot cannot access to some ressources of your page, this page won’t be well indexed”.

    Thanks for your help

    Julien

Viewing 3 replies - 1 through 3 (of 3 total)
  • The topic ‘Ressource blocked by Amazon robots.txt’ is closed to new replies.