Small update;
I have a site hosted at WPMU DEV hosting (wpmudev.com) the issue is mainly an apostrophe in the file name, it can be an image, video, pdf etc… (any file)
If you look at https://developer.www.ads-software.com/reference/functions/sanitize_file_name/you’ll see that WP itself actually treats em as a special character and removes them from the filenames in the function.
Means that WordPress does accept those files, which is good, however, this can be a treat to the server as well, hackers uses apostrophes to inject code as well, therefore, some hosting that uses a strong firewall, it will Never allow uploading files with apostrophe .
So, in case you have this issue, you would need to check your WAF as well and see if it is blocking it.
Hope this helps!
Cheers
Youssef