I’m afraid this issue won’t be isolated to just you. I haven’t been able to fully debug that functionality to be honest. We had a contractor build it into the plugin and I did some initial testing with various plugins I knew threw in Google Maps API into the frontend like Uber Menu and other Gmaps plugins.
Did you know this plugin is on Github? I’d LOVE a pull request from you if you polish up that conditional google maps loading functionality that we have. Here’s the link to the repo: github.com/WordImpress/google-maps-builder
If you do decide to contribute I’ll also throw in a free upgrade to the Pro version for your time.
Thanks!