Fixed.
Besides Theme My Login I was also using the CIMY Extra User Fields plugin. There must be some conflict between the two.
Solution:
I turned off the email confirmation settings in Theme My Login and turned on the same functions in CIMY Extra User Fields.
Now it works fine. I get an email after registering and it contains a link. If you click the link it confirms your registration.
All works fine now.