How to change sidebar image with diferent Categories?

I want to have different images on sidebar as per the categories. But the location of the image is sidebar. I unable to render a particular image with a particular category.

If say a post is opened under category “lifestyle” then it should show an image related to lifestyle in sidebar and so on for other categories.

I tried various Custom Category Field plugins but none of them worked.

Need some help.
Thanks