Disable Gravatars for Comments Only

Hello!

First of all I wanna say thanks for such an awesome plugin, my pagespeed is getting quite fast because of it.

My theme is called Readable by Proteus Themes and it works with avatars to show the author at the end of each post. With Gravatars disabled sitewide, the avatars for post authors no longer show.

Is there a way to have Gravatars dissapear everywhere on the page except for authors in the entry meta?

Thank you!

The page I need help with: [log in to see the link]