sure enough , at some point during our verbal fencing match , the taxi driver had obviously put his book down and gone on with the journey , and now he was about to turn into crown office row in the temple district , where the secret society of the guardians had its headquarters .