How can I add custom content on category pages?

I’m having so much trouble trying to do this, but it must be so common.

I have a products section 3 layers deep – Parent category, child category, post. eg Fruits -> Apples -> Golden delicious. But the parent category page needs a banner with an image and title, the child category page needs 2 images, a title and a sub title.

How do you add custom content to a category? I want to use ACF, but that just allows you to add a field group to categories in general, not specific categories.

Or am I not supposed to be trying to add content to a category? Is there another way that I haven’t thought of.

Thanks