@terence – Thanks, this was the only solution worked. There are way too many solutions floating around which are suggesting to change various file permissions which I feels is the wrong way to do it. You just need to change the ownership and make apache as the owner of the blog.
@ramgllc – You enter enter this command in your blog directory while using ssh
sudo chown -R www-data:www-data .