As Irish immigration accelerated the church building became too small. Property for the present church was bought in 1864 for $7,500. Jeremiah O'Rourke from Newark was chosen as the architect. The cornerstone was laid by the Rev. Bernard McQuaid, then Vicar General of the Newark Diocese, on October 23, 1864. The church was built of stone and measured 60 by 165 feet. Though unfinished, the first Mass was celebrated in the church in July 1866. The old church was sold on August 20, 1868 and it housed a factory unit it was sold again and became a meeting hall for the Grand Army of the Republic. The church was not completed until 1888 when the tower and spire were completed. The interior was also extensively renovated in 1890 when the marble altars were added. The church was consecrated on May 27, 1893 by Bishop Michael J. O'Farrell.