Cache thumbnails in media gallery

Is there a way to cache the preview images in the Media Gallery? Ideally we could do that bc it takes a long time to load the images below the fold. Most of the time spent in the Media Gallery is spent waiting to be able to scroll down because the images reload every single time.

The page I need help with: [log in to see the link]