I don't want to upload the file to my server, I want to keep the direct link

I want to publish a podcast, but I don’t want to upload the files to my server (I want to keep them in a separate, dedicated server). But when I paste the direct link however, it uploads the file to the server. Is there any way I can just put the media file link inside the enclosure without uploading it to the server?

https://www.ads-software.com/plugins/seriously-simple-podcasting/