Can you deactivate on a page?

Yes,
after installation of the GIF Player you are not obligated to use it for all GIF, just the ones, you want the GIF Player to be applied on.

If you don’t want to apply the GIF Player on a GIF file, simply upload / include the GIF the old fashion way in your post, by using “Add Media” instead of “Add GIF”.