Creating a custom theme, page preview doesn't show changes to page templates

The page content shows up correctly in a page preview, but when we change the page template, the layout doesn’t change in the preview at all. I have done a google search for this, and maybe I’m searching the wrong terms, but I can’t find the problem anywhere, much less a solution! I would greatly appreciate some help or direction on this.

Thanks so much!