This is not a friend, it’s a skeevy creep who you hang around with because you’re probably lonely.
I mean honestly, I’m not trying to beat you up or make you feel bad because maybe you genuinely do not know how to deal with anything. The right response the first time he touched you inappropriately was, get your hand off me, don’t ever touch me again, and go home now. And frankly you should have never hung out again, but if you did and he touched you again, you would say, I told you never to touch me again. Get out of here.
Definitely therapy to figure out why you it up with this shit. Don’t get into telling his wife, just never hang out with him again.