Prior to the construction of 3 Park Avenue, the armory of the 71st Regiment, New York National Guard was originally located at the address. The first armory of the 71st Regiment burnt down in 1902 and a replacement was completed in 1905 on a slightly larger section of land. The architectural firm of Clinton and Russell designed the second armory and in 1935 it was described as "Manhattan’s ugly old brownstone" by "Time" magazine, which was a reflection of a wider perception of the structure. The armory was eventually demolished during the 1960s and a decade passed before the site was redeveloped.