Remove Rating

I’d like to remove a star rating that was left on a comment all together so that it is unrated. I go in to edit the comment, clear the rating, then hit save, but afterwards, the original rating (2 stars) shows up again. Although I can change to a different rating, I cannot seem to be able to remove it all together. Any ideas? Thanks!