Page attributes, templates and Sidebars help

I’m trying to assign different sidebars to different pages. These sidebars have different widgets. For instance I have a directory plugin and the right sidebar has its categories that are related. Same for my blog where the left sidebar has related widgets. But I have more plugins like a job directory that need custom sidebars. How can I achieve assigning custom sidebars to these plugins?

Heres what I have so far. My theme allows me to make unlimited custom sidebars. I guess I just somehow need to assign the custom sidebar to a new template under page attributes.