I clicked on the message saying new release, please upgrade. When the upgrade failed, I was given three fields to enter connection details. I changed these to localhost and my ftp details, and the upgrade worked.
Not sure where you would do this for plugins, though.
