Keep the user on the home page in the event of a failed login?

Login form works great, using wp_form, but if the username/password are invalid, instead of reshowing the form with an error message, the user gets directed to the wp-login.

Steps to reproduce:
1. Go to this link, home page of new site
2. Enter random username and password (will be invalid)
3. Now you will see the wp-admin/wp-login screen, instead of keeping the visitor in the on the home page with the user friendly form.
4. If you enter valid login (u:wpforum p:welcome), you stay on the home page. Need to make it do that when the username/password are invalid.

Is there a way to keep the user on the home page in the event of a failed login?

Thank you for checking this out.