Definitely leave him. You have no reason to feel guilty, or to submit to his questioning and insults. You were apart for two years. He had a girlfriend during that time. Have you quizzed him on his sexual activity with her and others? Of course not, because that’s not what a normal person does. He’s a loser. Please lose him.