I just discovered that the whole CLS issue is present ONLY when I have image lazy loading enabled on both your plugin and Smush.
After disabling lazy loading within the Smush plugin CLS is gone. So, I no longer need to exclude logo from lazy loading.
Maybe you should put that tip in the plugin’s description as a side note.
Thanks again for making such an amazing plugin!