Log in to your WP admin page. Go to Settings > Discussion.
Make sure that the following options are unchecked:
Before a comment appears
– An administrator must always approve the comment
– Comment author must have a previously approved comment
You might also consider disabling (to avoid being spammed):
E-mail me whenever
– Anyone posts a comment
Good luck.