Image caption on white background

Usually when you add a caption to a image there is a grey area behind the caption. I’d like to remove that sitewide and have the caption under the image on the site’s background (which is usually white). How can I do that?

Cheers,
Zimbrul