I just made a site test with all plugins metioned above and the Page Builder is working very good, no issues. But most of plugins you want to use is outdated(3.3.2 , 3.4.2 …) and google map plugin not working because jquery java library used by some plugins (and themes)is older then 1.3.0. Maybe the theme have problems. on my test I used default Twenty Twelve, and the only major problem was that some plugins slowdown the site (google map, Exclude Pages from Navigation(you can use integrated menu builder), Per Page Sidebar Blocks (you can do the trick with page builder)…). If you can show as your site, we are happy to help you. I think the problem is the template used, and at last web server (10%).
Thank you Greg for your awesome builder