I’ve gone through the plugins in your list that I’m able to and have been unable to replicate this issue. Do you by chance have any custom hooks added to bypass the cache?
If no, are you able to go through your plugins and temporarily deactivate them one by one to see if there happens to be a new conflict or maybe even a plugin that is setting something that is leading to the cache being bypassed? When doing this I would recommend having your browser cache disabled when refreshing a logged out page a couple times to see if it’s been cached and then delivered. One way to do this is by opening your browser’s developer tools, going to the Network panel, and then enable the “Disable Cache” setting. The browser’s developer tools would then stay open on each logged out page refresh after a plugin was deactivated.