Polylang does not remember language

I have two languages set up in polyland, english and french. English being the default language. If I change the language to french and got to a different page on my site the language defaults back to english. Why is this?