Btw, an update to my original post: I changed my theme and it seems to be a lot faster now. Not sure what was going on with the previous one. It’s still a bit slow because of the large images, which I’ll be resizing eventually but at least it doesn’t take Google 18 seconds to load the homepage anymore.
Thanks for everyone’s help. At least I know it’s not entirely the server or database in this particular case.