I think your browser is properly configured for Unicode Bengali fonts.
First you need to install a Unicode Bengali font. To download click this.Siyamrupali.ttf
Then follow this steps.
1. Go to Firefox Options > Content > Fonts & Colors > Click on Advanced
2. Under Fonts for > Select Bengali from dropdown list
3. Select Siyam Rupali or any other good Bengali font.
After this, there should not be any problem.