one of the undecayed whateleys , from a different branch of that infamous family ; also the baxters who owned a broker 's house in new york together with the middletons cloth manufacturers from the mill town of bolton .