Ah! Okay. There is something broken about the way the .htaccess file is created. Whenever the .htacess file exists, I get the “Access Forbidden! You don’t have permission to access the requested directory. …” page.
<IfModule mod_rewrite.c>
RewriteEngine On
RewriteBase /
RewriteRule ^index\.php$ - [L]
RewriteCond %{REQUEST_FILENAME} !-f
RewriteCond %{REQUEST_FILENAME} !-d
RewriteRule . /index.php [L]
</IfModule>