In fact, the fix suggested by kashann for broken pagination also applies for non-loading sets. Find the function flickr_gallery_load_photoset (line 359 in flickr-gallery.php for version 1.5.2) and change get_bloginfo('wpurl') to $_SERVER['REQUEST_URI']. Works for me at least (running WP 3.1.3).
