Update: I found this plugin: User Access Manager.
It kinda do the work using roles, I had to create a separate role for each user so I can select which pages each user can access. It’s not a big deal since I will have like 30 users so I can do the work.
I’m going to keep looking for a neater solution.