If you need to hear it from someone else, LW, this guy is not your friend. He’s gross and disrespectful, to you and to his wife. I don’t remember the details of your last post (like ages, if you included that), but at 22 years your senior he sounds like a sketchy predator. And I mean he’s assaulting you so… he is a predator.
I think the therapist’s advice to set boundaries and then enforce them (by ending the friendship) is fine… it’s LW who has not been doing that but needs to, and acknowledges she has not because she is lonely.
You’re not accountable for the bad behavior of men, LW, but you are accountable for your own. You need to work on your self esteem so that you are making healthier choices about the company you keep. I promise being lonely is better than this. You also need to work on building your community/support system.