Viewing Theme without activating

Is there a way to view how your site looks with a different theme other then the one currently in use, in other words, to view a theme without activating it first?

There’s one I want to try, but want to test it first.

Thanks.