OK I was able to figure out the issue. I ended up adding the following css to my child theme
.entry-content img.alignleft,
.entry-content .wp-caption.alignleft { margin-left: 0;
}
.entry-content img.alignright,
.entry-content .wp-caption.alignright { margin-right: 0;
}