Thanks for the quick reply.
OK, then I misunderstand the default behaviour. To me ‘Remove my custom settings’ and ‘Remove Settings on Uninstall’ should completely remove any customizations I’ve made. That doesn’t happen.
Once I manually deleted the logo and background image before deinstalling the plugin, I’m back to where I want to be.