Great feedback everyone, thanks!
I had to create the /wp-content/upgrade directory (it was not present), set permissions to 777, then update the permissions in wp-content/plugins to 777 as well. Finally, I emptied /wp-content/cache – and plugins are now updating successfully.
Thanks for the help.