once hart , the duke in question , had officially acknowledged fellows as part of the family , he 'd made it known that fellows could walk into and out of the grosvenor square house anytime he chose .