Permanently delete theme

I did some work locally on a child theme which I am also running on my site.

I deleted the child theme on the site, but when I try to upload the new version that I’d been doing locally, I get the message that the file already exists. I’m assuming that this is because the old version still exists somewhere on the site. How do I get rid of it?