I am experiencing the same behavior. Super-Cache is saving pages in its cache, but then generating new pages for each visit. I’ve taken similar precautions about not being logged in as admin.
I’m also on 2.8. I don’t know when this started, though. I know it worked distantly in the past.