Figured it out….

With the UserAccessManager and Adminimize plugin it works wonderful.

Every portfolio a separate categoryname, define every user (author) as a group linked to the specific categoryname.

With Adminimize I removed for the role “author” all the other links to pages, posts, etc, so there is no confusing about all the other buttons in the admin area….