Can't get in to admin on sites (redirect loop)

I just set up multisite and am having some trouble with a redirect loop.

The new ‘site’ is loading, but I can’t access the /wp-admin page, that is when I get the loop. I have seen this in some old forum posts, but they all seem to be attributed to some 3.1 problem.

I have disabled my caching plugin too, that didn’t help.

Any help on why this may be happening to just the admin area is sincerely appreciated