I would add 404.php as well. You can see an example on the default WP theme. This is extremely useful, as it will load in the event of a 404 rather than the index. This could confuse some readers and they may try accessing the missing page again, only to be redirected again, et cetera.
Also, page.php for any pages they may make. I’ll post again if I think of any. :]