Titles only in Archive.php

I would like to have my archive.php to display titles only (and of course link to the individual articles), so that the category, tags, date, author, etc. pages will display an unordered list of titles.

I can do that with manipulating the archive.php, but then the number of articles to display will show what was indicated in “Blog pages show at most” in the Settings. I can do a custom query but then there will be no navigation to the previous articles (e.g., I can show the last 25 articles only).

Simply, I would like to override the “Blog pages to show at most” but then there should be a link to the previous articles (second page) if say the number of posts I wanted to display is less than the actual number of post for that category, tag, date, author, etc.