Accuracy is pretty bad – 30-40% false pos results

  • The accuracy is just plain bad.

    Not sure what other way there is to put it. Tested on over 30 plugins!

    The docs say:

    While this plugin is written to detect as many problems as accurately as possible, 100% reliable detection is very difficult to ensure. It is best practice to run comprehensive tests before you migrate to a new PHP version.

    Not even close to 100%. False positives about 30-40% of the time. That’s not usable. Please put some work into this or take it down.

    Too many errors to list.

    What you said:

    It is best practice to run comprehensive tests before you migrate to a new PHP version.

    Is absolutely true…in which case you don’t need a plugin.

Viewing 2 replies - 1 through 2 (of 2 total)
  • Plugin Contributor Jason Stallings

    (@octalmage)

    Hi @blackhawkcybersec,

    This plugin uses a popular PHP library for compatibility testing:
    https://github.com/wimg/PHPCompatibility

    This is static code analysis, which will never be 100% accurate. We try to make that as clear as possible. At WP Engine we use it as a starting point. We scan thousands of sites and the sites that pass we consider compatible.

    I apologize if this plugin wasn’t useful for you. If you’d like to help improve the scanning feel free to create issues here. They are very open to all suggestions!

    Thanks for your feedback!

    Thread Starter blackhawkcybersec

    (@blackhawkcybersec)

    This is static code analysis, which will never be 100% accurate.

    Yes, I know this. I’m a developer. It’s not an effective method.

    At WP Engine we use it as a starting point.

    That doesn’t make it a good method.

Viewing 2 replies - 1 through 2 (of 2 total)
  • The topic ‘Accuracy is pretty bad – 30-40% false pos results’ is closed to new replies.