Sorry for the cross post…
Just figured this out. In the Comments section in the theme editor there are two sections that have Google Adsense code already in there. For some reason Firefox ignores this but IE wants it to be something. I deleted all the code related to the Adsense stuff (presumably you can add it in later if you use Adsense and enter the correct info) and now all seems to be fine.
