Different permalink for categories and posts

Hello,

I would like to set up different permalink system for categories and posts. Posts permalink should be:

/posts/%post_id%

but when I use this permalink, categories permalink is changed as well in a very disgusting way – it becames /posts/category/3.

How can I remove this “posts” when single post isn’t being viewed?

Thanks