Comments closed But Still posting comments

On site I decided I didn’t want comments and turned them off.
I then edited all template files with comment code in them and took them out.
I flipped through my site and nothing comes up to post, edit or read comments, GREAT! or so I thought.
I go to the administrative back end and notice I have NEW comments held in moderation!
What gives?