Gallery images out of order in viewer

I inserted a gallery into each of my pages on my website but if I make ANY edits to that gallery it doesn’t appear like it should in the viewer- even though it is showing it correctly when I click on the full gallery view. For instance, if I add/delete a few photos in the gallery and reorganize them they look just fine in the gallery edit screen for that page but once I update and actually view that page online and click on an image to view closer and try to go to the next one it is out of order. It just jumps around my gallery instead of following how I organized it- so it appears to be right when you have that page open showing all gallery images but once you bring up the viewer to get a closer look at the images that is where it starts messing up the previous and next images. Any ideas besides deleting and reuploading each gallery??