Well, I had the same issue and looked at another more or less exactly WP installation and one of the differences where that my own WP has WordPress auto upgrade plugin installed and the other didn’t and there was no issue with either upgrade or issue with notice of upgrade.
So in my case the solution was to disable and as well I deleted the wordpress auto upgrade plugin and voila issue solved.