False negative

  • Resolved asafm7

    (@asafm7)


    4 years, 4 months ago

    Hi,

    I tried to test the plugin with this 404 link:
    https://www.amazon.com/Blendtec-Professional-Grade-10-speeds-Certified-Refurbished/dp/B00

    Although broken, The link tests OK with 200 response:

    Link last checked: July 14, 2020
    HTTP code: 200
    Response time: 0.158 seconds
    Final URL: https://www.amazon.com/Blendtec-Professional-Grade-10-speeds-Certified-Refurbished/dp/B00
    Redirect count: 0
    Instance count: 1
    Log: === HTTP code : 200 ===

    Response headers
    ================
    HTTP/2 200
    content-type: text/html
    content-length: 6698
    server: Server
    date: Tue, 14 Jul 2020 05:39:51 GMT
    vary: Content-Type,Cookie,Referer,Accept-Encoding,X-Amzn-CDN-Cache,X-Amzn-AX-Treatment,User-Agent
    edge-control: no-store
    x-amz-rid: X75S3ZXBNZGQ5D9N9GBT
    x-cache: Miss from cloudfront
    via: 1.1 a350f357b825293e306b1b0a2cb490c1.cloudfront.net (CloudFront)
    x-amz-cf-pop: FRA6-C1
    x-amz-cf-id: m8bQJLMr0e6_65cbsm9hRC7Mk9OP5bTR-4Or1ZOFTTXD99bMv4Uv0A==

    Request headers
    ================
    HEAD /Blendtec-Professional-Grade-10-speeds-Certified-Refurbished/dp/B00 HTTP/2
    Host: https://www.amazon.com
    User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.102 Safari/537.36
    Accept: */*
    Referer: https://simply-hobbies.com
    Connection: close

    Link is valid.

Viewing 2 replies - 1 through 2 (of 2 total)
  • Plugin Support Williams – WPMU DEV Support

    (@wpmudev-support8)

    Hello @asafm7

    I hope you’re well today and thank you for your question!

    Some links/types of links do “deliver” such false negatives/positives, I’m afraid. In case of Amazon and a few other services it happens that these services apparently are able to identify (or at least “suspect”) that request/traffic is “automatically” generated here and they provide different response to such automated request than they do to a regular browser.

    I can see by visiting the URL in question that it indeed responds with “404 Page Not Found” and it’s not only “Not found” page but a legitimate, expected HTTP status 404. The debug output that you’re getting, however, clearly states that Broken Link Checked did receive 200 OK status from target. There’s no full content of response, especially that the request is always only for HTTP headers, so it’s hard to say what the response contained – it might have been e.g. proper response containing some information stating that “automated requests are locked” or similar. Still though, it was a valid 200 OK response and that’s why plugin marked link as valid.

    Amazon and some other services, unfortunately, would require API connection. We are already looking into this and our developers are planning to add support for such services in future but it might take time as it’s quite a complex task and involves addressing multiple target services separately (dedicated solution for each of them).

    Kind regards,
    Adam

    Thread Starter asafm7

    (@asafm7)

    Thank you for the detailed response.

    I’m happy to know you’re are familiar with the issue and working on it.

    My Amazon links (and I guess it is the same for many others) are affiliate links – so it is very important for me to get notified of broken Amazon links.

    Hopefully, you will be able to implement it soon.

    Thanks again,
    Asaf

Viewing 2 replies - 1 through 2 (of 2 total)
  • The topic ‘False negative’ is closed to new replies.