How do I change the order of the posts in the series?

I’d recommend to use a plugin like Simple Custom Post Order, activate posts to allow ordering in the settings and then you can drag and drop the order oft the posts (that belong to a series).

Of course you can order all other posts as well, what you most likely don’t want.