OK, I think now I know when exactly this happens.
If I de-activate any plugin that adds its own columns to Posts/Pages screens – Yoast SEO columns start appearing first, even if they were hidden before.
Just tried to reproduce this behaviour with StatComm plugin a few times.