All Angels' Church was founded in 1846 as an affiliate of St. Michael's Episcopal Church, the main campus of which was located at Amsterdam Avenue and 99th Street. All Angels' was intended to be a mission to the residents of Seneca Village and nearby areas. At first, the church was hosted in a white policeman's home, but a wooden church at 84th Street was built in 1849. The congregation was racially diverse, with Black parishioners from Seneca Village and Irish and German parishioners from other nearby areas. It had only 30 parishioners from Seneca Village. When the community was razed, the church relocated a few blocks west and was officially incorporated at the corner of 81st Street and West End Avenue.