Started having the same problem as soon as I updated to 3.4 as well. My other sites with version 3.3 still work perfectly (with the same theme installed!). The only workaround, as @wecandothat said is to upload the image via the media library and copy and paste the link.