How to change the markup of the block?

Use the filter breadcrumb_block_get_breadcrumb_trail to change the output markup of the breadcrumb:

add_filter( 'breadcrumb_block_get_breadcrumb_trail', function ( $markup, $args, $breadcrumbs_instance ) {
	return $markup;
}, 10, 3 );