Different font for Japanese

No, you cannot do this with Polylang alone.

You could example
1. Modify your body_class to detect active language https://developer.www.ads-software.com/reference/functions/body_class/
2. Then target your font-family change to Japanese body class with CSS