Feed Issue

Hello All ,
My site hornbag.net is installed in a subdirectory of my webserver. When you go to the footer of the site and click on one of the feed links you get an error. I have created the folders etc on my server ie ‘https://www.hornbag.net/feed/rss2/’ however I always get the same issue –
Forbidden
You don’t have permission to access /wp-feed.php on this server.
Apache/1.3.27 Server at https://www.hornbag.net Port 80
Am I supposed to put the wp-feed.php file into my https://www.hornbag.net/feed/rss2/ directory?
I didn’t have this issue when I had wordpress installed on my root server.
Many Thanks,