I ended up fixing it with the Freesoul Deactivate Plugins Plugin so that it is only rendered on one page.
Is there any way I can make sure that only items from a certain category are shows when I use the filter? Currently, when I filter by products on SALE, my results include products from ALL CATEGORIES. I only want the result to show from a certain category. Is this possible?