menu to display posts for single category by year

On a single category, I’d like to have a menu that allows the user to click a year, and see only posts from that category, by the year selected. I’ve seen a number of sorta solutions, tried this one, Simple Yearly Archive, but it simply spits out a list of all the posts sorted by year.

ANy way to spit out a menu of the year links, and being able to go to the archive page and see only that year of that category? Seems like a simple thing but hours of searching hasn’t given me what I’m looking for. Many thx in advance.