when you open javascript console you can see some error – thats cause problem why toggle button doesn’t work .. try remove js file from header ..
your error message: Uncaught Code.PhotoSwipe.createInstance: No images to passed.
code.photoswipe-3.0.4.min.js?ver=3.0.4:133