Quoted By:
Wow. Strangely hostile in here. Then again, I'm a visiting fa/tg/uy, maybe this is normal for you /adv/anced sorts. Anyway. On the topic.
I have an issue with being touched. Mine is actually a physiological one, as my sense of touch is acute enough that the sensation can actually be painful at times. Seriously, not fun. On the other hand, I've found people are surprisingly understanding even without explanation - seriously, a simple 'I don't like being touched' is accepted without question by most, and only one or two wanted more information as to why, and that was mere curiosity on their part.
Long story short, take him aside and let him know you're uncomfortable being touched. He'll appreciate the honesty, and while he might be curious as to why, having an explanation at all for your jumpiness would definitely go a long way towards making him feelbless awkward about the situation himself.
Anyway, random advice from a random neckbeard. Hope it helps!