Noob trying to understand

I’m considering dling WordPress so I can use a custom theme. If I do so, then upload it to my current non-WP web host, will I be able to edit my site from anywhere, or only from the machine I designed the site on?

Thanks so much for your patience and help.

-Liam