I run a number of sites, and this problem only occurred with one of them. Strange.
The only way I could solve it was by installing a backup though the blogvault service.
I know that does not help any of you who not take backups or use a backup service, but I suppose the real lesson to be learned is not to install WordPress upgrades until the bugs have been sorted out. This is the last time I will rush in to upgrade first thing…