Backslash before apostrophes

Recently, I have noticed that in the comments I write on my own blog, a backslash is added before an apostrophe and a quotation mark. This character is added after publication and cannot be edited out. Example:

\”We\’re in good company with our love of cheese. There\’s a certain fellow named Wallace who rather likes a nice bit of Gorgonzola now and then.\”

What’s going on here and how do I make it stop? This does not occur when I write a post, and other people seem to have no problem writing comments. It only happens when I write a comment.