Well, it looks like deleting the plugin from the backend didn’t really delete it. I had to go to the server directly and trash the file. Thankfully the code disappeared with it. I’m normally impressed with Yoast products my experience with the GA plugin and not hearing any support response on this have me thinking twice.
