of course , the math of the whole game was quickly lost in the chaos of remembering exactly which way the batter was meant to be facing , and balls being pitched at the back of the batter 's head when he guessed wrong .