Admin toolbar cached?

When you use a cache plugin, is it normal for the admin toolbar at the top to be cached too? I noticed this when I installed a plugin. It would not show up in the toolbar and I was forced to clear cache.

Many thanks