he never asked andrew upstairs for any reason , and andrew would not take it upon himself to intrude on sir 's privacy ; and so from that time on andrew saw sir only on those infrequent occasions when the old man chose to descend into the main part of the house .