Yes.
But you need to override WordPress defaults if you want to use it. You can allow unfiltered downloads by admin users by adding this line to your wp-config.php file:
define( 'ALLOW_UNFILTERED_UPLOADS', true );
Or, you can add just the mime type SVG individually (and not all of them, which IMO is overkill) using the following code added to your child theme functions.php:
function my_custom_upload_mimes( $mimes ) {
// Add SVG to the list of mime types
$mimes['svg'] = 'image/svg+xml';
return $mimes;
}
add_filter( 'mime_types', 'my_custom_upload_mimes' );
Or, if you’re a newb and confused by all this, you can use the plugin Add Mime Types to add mime support for other file types with an easy-to-use GUI.