I also found that this plugin was causing memory overload on my server. I would get 404 errors frequently when doing things in the admin panel, especially checking my site stats via Jetpack. But it would also throw a 404 even when editing a page or adding a post.
So I’ve deactivated it and things seem to be back to normal. I think junger’s suggestion is the way I’ll go too.