Sorry I did not see your reply until now. I checked the settings for the subscribe page and it has a default thank you message. See here. It is strange that no confirmation email is sent when using the plug-in but but it is sent when using the subscribe page directly.
I am forcing HTTPS on the domain via an .htaccess file. Though I don’t think that would cause the confirmation email to not be sent.