Hello
It is exactly the same thing happens to me. Even configured to backup daily, when I check the log I see that the backup began the moment I connected to wordpress and not on time in the setup.
I’m not using any caching plugin. Now … I would like to understand what the “external site” means. Sorry my English. I’m using Google Translator.