Chnage WordPress template to look like my website

I have a company blog in wordpress. I want to change the entire template of the blog to look like my website.. so i have downloaded wordpress and started to change the template. I have changed header and footer successfully and it reflects in every page..

I want to add a Left side bar which should reflect in every page. so which template file i need to change so that it reflects in all the pages in the blog.