I had this same problem with the choice appearing in the settings > discussion dialogue but not the picture. It turns out, the problem was I was using a child theme and get_bloginfo(‘template_directory’) points to the parent theme directory. I fixed the problem by putting my custom default avatar in the parent theme’s image folder.
