You say you feel guilty but you didn’t do anything.
You didn’t fondle him, but why are you seeing him? What good is coming from this?
Many people would say you are an adult and it is your choice to spend time with a man who sexually abuses you or not, and you keep seeing him. You can stop at any time. Why would you see him at all is the mind boggler.
You don’t have to tell me what’s going on, but this is not healthy behavior,