Thanks for the reply !
I’m using new Woocommerce Checkout Blocks, not shortcode.
This behavior is only when using Paypal’s Express Checkout
There’s no phone number in Paypal shipping address and Woocommerce seems to validate the order without required shipping phone.