Thanks for the hint. I have added a workaround in version 1.0.3.
Instead of checking if xcache_unset_by_prefix exists on every request I only do so in the flush() function as it is only used there. On a stock WP install flush() is only used by the upgrade script.
