Can You Add Icon Graphics to Quicktags?

I would like to add icon graphics to the quicktag links instead of having type.
How can that be done?
I would also like to add a screen help message when you mouse over the quicktag link.
Thank you for your help.
Randy