I wouldnt recommend to add any caching plugin while you are working on your website, it seems to be a caching issue, or any optimization plugin, that could be causing this. Anytime that you need to change the content of your website, turn off all caching and/or optimization plugins and activate it after your changes, so the caching will be regenerated and you will be fine.
