The original Factory was on the fifth floor at 231 East 47th Street, in Midtown Manhattan. The rent was one hundred dollars per year. Warhol left in 1967 when the building was scheduled to be torn down to make way for an apartment building. 