Post formats effecting single.php when it shouldn't

I’ve created an aside post format for less important posts on my blog, as seen here. I only want the aside post format show up on the front page and in archives, and all posts to look like the standard posts in single.php.

However, when I look open an aside post after changing the CSS for the aside format on the front page, it looks like this when it should look like this. It seems like the “format-aside” class is added to aside posts in single.php, which means that any changes I make to the aside post format on the front page effects the look of single posts as well.

Is there any way around this? What I want to do is to have the aside post format look different on the front page, but look like the standard posts in single posts.