You are too polite and these people are toying with you.  Do not complain to the boss, they haven't been overt enough and will deny coming on to you. 

When they sit close and rub your leg, say loudly, "Am I crowding you?  Here, let me move to give you more space." Then move.  When they whisper in your ear, turn and stare, then repeat what she said loudly.  When a conversation gets awkward, "well it's been real.  Later." Belch rudely as you leave.

IOW, stop taking their crap.