I figured out it clears the cache any time anything is changed/saved on the site, saving settings on any plugin, new posts, drafts, trashed, new plugins, deactivating plugins. It clears just saving setting in general settings with out changing anything.
Ive tried many different cache plugins and this one is the only one that has this issue.
I do have JetPack boost for css and images, I deactivated it and the cache still clears.
Normally I would move on to a different plugin but this one hands down out performs others. At one point I had 99 on desktop, 87 on mobile for googles speed test with no issues. Its not there now as Im trying to figure out this issue. I just need it to stop clearing the cache.