Ah, thanks for reminding me of the error logs, at some point I messed up the category.php file and there was a stray angle bracket from somewhere.
In any case, I’m using the archive.php file for tags, so I just removed the category.php file and reverted to archive instead.
Thanks for the help though.