That’s exactly my problem; I try to add the close tag in the post editor, either by simply pressing carriage return, or typing /p explicitly. Either way, it doesn’t stick. The editor doesn’t save it, it just disappears and the problem persists.
I’m running WordPress 1.0, in case you were wondering.