Disable network activated plugin on one site

Is there a way to disable a network activated plugin on one site in a network. I have a plugin that is causing 404’s to occur with the custom post type/taxonomy pages on one specific theme that I would like to use.

I would like to be able to disable this plugin on the sites that are using this theme. The plugin seems to only allow Network activation.