This is very similar to another letter in the forums this week:
https://dearwendy.com/topic/should-i-stop-seeing-my-fwb/

At least in the other letter the guy seemed to treat the woman nice enough. Your dude isn’t even nice to you. There’s no future for you in this relationship. It’s just sex and you’re clear that you want an emotional connection and the dude is clear that he doesn’t. The sex may feel good physically but it’s leaving you emotionally unsatisfied, and the more you keep sleeping with the guy, the more emotionally unsatisfied you’ll feel. Beyond that, it’s affecting your self-esteem. You’re beginning to wonder what it is about YOU that he doesn’t want more than just sex from you. But it’s not about you; it’s about him. To be emotionally invested in someone requires some effort and he doesn’t want to make the effort. This is not a reflection on you. But since you aren’t in the headspace to see that clearly, it’s really imperative that you move on from this guy. Delete and block his number and don’t sleep with someone again unless you are sure you only want sex or the guy has truly invested in an emotional connection with you.