I wanted to add: I did create a separate tax class called “NC Food” and put it at 2% but WooCommerce is changing it to 6.75% after I reload the page.
It seems WooCommerce needs a setting on each Tax Class for Automatic Updates, and not to the entire system.