Limit Replies to Original Poster

Hey guys!

Is there any way to limit replies in posts to certain users? The basic system I want to build is where someone can post a comment on a certain post and only the person who posted the post being commented on can reply to the posts.

If thats confusing, the basic hierarchy should be like:
1. Unregistered user submits comment on post A.
2. Only poster of post A can reply to the comment from unregistered user.

On a technical level, I’m lost as to where I can break down this code
comment_form();
into both the reply and comment sections, in order to put the appropriate user checks in place.

Thanks!