Based on what you wrote – you sound pretty manipulative here.
You say: so when I can tell he’s busy or maybe just not in the mood to talk I just say ‘I’ll leave you to it, message me later’ but he will just continue the conversation
How I interpret this: When I don’t feel he’s giving me enough attention instead of saying good bye, I imply that he’s not giving me enough attention and he’s not picking up the hint.
You say: So I decided it would be good to just move away from each other for a bit, when I said this and that I won’t bother him, he just ignored it and started a conversation.
How I interpret this: Instead of just ghosting him or being less available I tried to use guilt (I won’t bother you) to see if he would respond.
Honestly, as you’ve described, either he’s clueless or simply ignoring the games that you’re playing. If you don’t want to talk to him. Just stop answering his calls & texts.