Only resize when uploading featured image

I realize that I only use image sizes for the featured images as I always use the full size image within the content of the post.

Is there any way to tell WordPress to only resize images I upload and set as featured image, instead of resizing every single image I upload, which end up being a waste of space and image duplication?

Thanks,