Remove comments section when comments are disabled

WordPress leaves the html for the comments section in the code even when comments are disabled, like this:

<section id="comments">
</section>

What is the best way to remove this? Thank you…

(The best way would be if WP didn’t leave it there in the first place. Seams an obvious problem: you style the section#comments with a padded box; and that displays even when comments are switched off on a page or post)