How to drag and drop attribute to a different page when you have 100+ attributes

I have more than 50 products on my store which means more than 100 size attributes. On the front end, the size options are all jumbled up/not in order (3XL is placed before Size S etc). I know i can sort the order on the front end by going to woocommerce > attributes tab and choose custom ordering as an option to sort the sizes by drag and drop but i’m only able to drag a particular size to a certain point on the page. I can’t figure out how to drag the size S on page 5 to page 1 or wherever so that the sizes are in order on the front end