Uninstalling breaks incoming links from Google

I uninstalled AMP. Now, when people search for my site on Google, they see an AMP link, click on it and get a 500 error.

If they use the “Click here to continue” they get redirected to a 404 page! Why? Because example.com/post/amp doesn’t exist.

What are my options here? Am I now forced to keep this plugin active? Is there any way I can fix these broken links?

I’m not very happy with this.