Settings only applied to logged in

Hi,

I have this weird problem that whenever I make updates to anything related to the layout of my site, I can only see them when I’m logged in, but not when I’m not logged in. So if I change for example the header border from 10 to 15px, it shows 15px if I’m logged in and 10px when I’m not.

And also, to be able to see the changes, I first have to log out and then log in again.

I read somewhere about a similar problem and that it might have to do with WP Super Cache, but since I’m still a newbie with WordPress I don’t want to mess around with the plugins.

Thanks in advance