Listing the article under Category

Dear All,

How can I show latest 4 Article under Category.?

Example:

Category Name1
– Article 1 Title from Category Name1
– Article 2 Title from Category Name1
– Article 3 Title from Category Name1
– Article 4 Title from Category Name1

Category Name2
– Article 1 Title from Category Name2
– Article 2 Title from Category Name2
– Article 3 Title from Category Name2
– Article 4 Title from Category Name2

Do I need some plugins? Or should I add some code in templetes?
I used Twenty Ten 1.0.

Can you help me?

Many Thanks in advance.

Cheers,
Magi