Disabled plugin and no pages updating outside dashboard

Everytime I make a change the admin dashboard, it views and updates fine.

Once I log out and view the same page, and older version of the page is shown until I re-activate the plugin and clear the page cache.

How do I prevent having to do this everytime?

I installed the plugin for a few minutes, didn’t change any default settings, and decided to deactivate until I finished designing my website (as the load time was a lot slower and I wan’t to deal with it last).