there was a lone doorman in the lobby to the highrise where the governor kept an apartment for those days he did not feel like being driven home to the hillside oakland estate he shared with his wife .