In 1854, the Christian Brothers were invited to Albany by Bishop McCloskey, to open an orphan asylum for boys. To help support the asylum, the Brothers began a pay school in 1859 in which eighty boys enrolled. Stagecoaches carried the boys from downtown to the school's rural location. After a few years, a separate building on Madison Avenue was secured. In 1869, the school was chartered by the University of the State of New York and a brass band was incorporated at the school. Over the next twenty years, the school outgrew its facilities several times. Each time, it relocated to a larger site. In 1882, the school moved to Lydius Street and in 1886, the Brothers purchased the former Normal College at 43 Lodge Street from the State Education Department. Classes were conducted in this building for the next fifty-one years.