Ah, there’s actually a constantly hidden option in the “screen options” dropdown at the top for the “slug”. If you check it on, you can edit it in a separate meta-box –- usually placed at the bottom of the page.
Also, I really would like the edit permalink button from pages on media pages. I came here looking for the exact same answer before I remembered the slug option.