Setup a client user website with restictions

Hi, for the last 4 weeks I been searching for a solution to get users, clients and project leaders collaborate.

In short:
I want to assign single users to a page that is restricted to only the assigned users.

The thing I want:
I have a protected/restricted website (members plugin).

Group 1 company employers:
On this website a main group (company employers) can log in and see the company discussion forms (Buddy press) but can not change any thing on the website. This part works

Group 2 Company employer:
Company employer that has access to a single page that the project leader (group 4) assigned him to. He can only view this page and download documents but not change or update anything.

Group 3 Customer:
Customer has also access to a single page that the project leader (group 4) assigned him to. He can only view this page and download documents but not change or update anything.

Group 4 Project leader:
The project leader has access to all pages and can assign single users and single customers to the same page. He can upload documents and change content.

Example:
Project leader 1 creates the following pages:
Project 1
Project 2
Project 3

User 1 (employer)
is assigned to project 1 and project 2.

Customer 1 is assigned to project 1 and project 3.

So User 1 can see the same page as customer one for project 1 but the can’t see the other project user 1 or customer 1 is assigned to.

I really tried many plugins to get this working.

Almost I got it working but I need to take in account that I need to integrate Advanced Custom Fields plugin with this. It also needs to work within a WP network.

My Setup:

WordPress network 3.6.1
Buddypress 1.8
Advanced Custom Fields
Members plugin

Tried plugins:
Collabpress
Capability Manager Enhanced
BuddyPress Docs
BuddyPress Groups Extras
Role Scoper (to much options)

Thx