Yes thats correct, write whatever you need to write in ‘Visual’ and then just add the actual link itself in the ‘Text’ view..
Its not ideal but i find it works – until the problem gets sorted by WP.
I myself use the visual view for pictures and havent seen too many issues, the problem that i have experienced is mainly when i do text links