Cleared or not cleared

Invariably when I’m testing my site, I’ll turn off this plugin. But even when I refresh, clear the browser cache, or clear the WordPress cache, my page may still look the same. I’d be okay if there were rhyme or reason to it. Instead, it seems completely random.