OK I figured it out. I was missing some fields in my CSV. I referred to the example .csv in the documentation and added the ID, post_status and visibility fields and once I did that the product showed up. I think the post_status field was the crucial field to have. You can set it to publish, draft, etc…
