Is there a modification I can make to get the sidebar to appear on every page?

Hi there @cvr2006 – Twenty Eleven comes with an optional page template with a sidebar.

With your page open in the editor, click the template name in the panel on the right and select “Sidebar template” to apply it, as you can see in the screenshot below.

Let me know how it goes.