I’ve been in a similar situation but with a guy who thought it would be fun to grab my boob in public on a bus ride under the guise of a half hug. First date.
Me: stop
Him: Why?
Me (best bitch face): because I said so. (End of discussion.)
Him: what can’t you take a joke? (or insert any other inane bullshit about why you should just put up and shut up)
Me: No. I can’t. I guess it’s not meant to be.
I don’t blame you for just faking it to get out of there. You don’t owe this guy any more of your emotional energy. Save it for people who are worth it.