some men winked at thomas or tipped their hats and he returned the gestures because he knew they did n't see him as the enemy , knowing he was far too slippery to be caught holding fast to either side of a fence .