I do not believe that you can limit access by category, but you can limit the users to to editing only products that they created. there are several plugins that can help you do this
https://www.ads-software.com/plugins/search/roles+and+capabilities/
There is also information in the Codex if you prefer to write your own:
https://codex.www.ads-software.com/Roles_and_Capabilities
Finally, I did a little research for you and found this: https://wp-types.com/documentation/user-guides/custom-woocommerce-roles-admin-capabilities/ which might be helpful to you as well.
Good luck with your shop!
I hope this helps,
-Shaynald