Carousel with videos

Yes, you should be able to insert a YouTube shortcode into the slide content – see here under “Embedding with a Shortcode” heading:
https://wordpress.com/support/videos/youtube/

You need to make sure that you have the ‘Allow Shortcodes’ checkbox ticked in tour slider settings.

Thanks!