Image Attachment Page Best Practice?

I’m seeing Google indexing my image attachment page. On one hand it’s sort of bad as the user can click through and then potentially bounce due to lack of content, however my navigation is clear and simple to get to other pages. On the other hand, in some cases I’m occupying 3 of the top 6 organic search results: location specific landing page, location specific contact page, image attachment page for image used on landing page. If I prevent indexing of image attachments or redirect, then I’m only occupying 2 of the top 6 positions.

So is the consensus that the potential increased bounce rate of the image attachment page not worth having it indexed? I suppose maybe if I redirect all attachment pages it could have a minor positive effect on the parent page using it by transferring a little internal link juice?

But what about new pages with new images? If WordPress (with Yoast plugin) is providing an image attachment URL to Google to index, but then when Google goes to index the new image attachment page and just sees a redirect, that seems like it could be let’s say “curious” to Google? So would best practive be to redirect exsiting image attachment pages and turn of indexing of all new images? If this isn’t an option in Yoast, then how?