In 2004, some business owners in Midtown announced their opposition to a proposed 16-story ventilation building at 50th Street east of Madison Avenue. They stated that the building would cause pollution and that it could be vulnerable to terrorist attacks. In particular, Catholic Archbishop Cardinal Edward Egan of the Roman Catholic Archdiocese of New York was concerned about East Side Access's impact on St. Patrick's Cathedral, which faced Fifth Avenue with its back on Madison Avenue north of 50th Street. Despite this, the MTA affirmed its plans for the ventilation tower at that location. After continued opposition from the Roman Catholic Archdiocese of New York and other nearby entities, the MTA reduced the size of the building and relocated the structure's cooling towers.