Adding featured image next to each post in a category list

I’m wondering if there is a way to add the featured image for each post listed for a category as a small icon similar to this: https://www.ourbestbites.com/category/recipe-index/soups-and-stews/ ??

My page currently looks like this: https://www.nodietsallowed.com/recipe-index/appetizers/ but I am wanting the featured image for each post shown as well. Is this possible with this plugin?

https://www.ads-software.com/plugins/post-category-index-generator/