Gray Boxes on Pictures with Caption

I need to add some picture credits to the pictures I am using on a website. I found a sweet plugin to allow links and that is working great.

The problem is, when I insert a caption to the picture a gray box then appears around the whole thing. I have borders turned off in the custom theme I made, but how do I get rid of this dynamic box with caption?

Anyone have an idea?

Here is the live test site: https://test.techquility.net/theraganlawfirm.com/family-law/child-custody