Numbered pages for posts navigation link

Is there also a way to output numbered page buttons in addition to the “previous” and “next” buttons? So if there are 4 pages of content, is there a template tag or plugin that allows for something like this:

<previous 1 2 3 4 next>

I can’t seem to find any documentation on this, but if anyone can lead the way, I would be most appreciative!

Thanks.