Thank you both for your answers.
I do have caching on the website but both purging and disabling altogether did not help.
@luminus The Store notice was already disabled but this still persists. I tried re-enabling the notice, publishing, disabling again and publishing. Unfortunately it still persists.. The weirdest thing is that the text in the store notice under Woocommerce>Store Notice is completely different than what is popping up.
Anything else I can do at this point?