they were four blocks from the white house , on pennsylvania avenue , when the ss driver flicked on the intercom , and informed them that he had to make a detour , but hopefully they would be on schedule for the briefing .