Swampscott Town Hall is set on an expansive lot overlooking the town's soldiers memorial and Linscott Park in the town center. It is a two-story brick Georgian Revival structure with a tiled hip roof that is crowned by a low balustrade with turned balusters and urn-topped posts. The main facade is asymmetrically fenestrated, but there are symmetrically placed gable dormers in the roof, and the entrance is in a slightly off-center gable-topped projection. The building corners, as well as those of the entry section, have Ionic stone pilasters at the corners. The main entrance is sheltered by a round portico supported by fluted Corinthian columns, which supported an entablature with a carved frieze. The portico is topped by a balcony with a low railing slightly different from that on the roof. Above the entrance is a French door flanked by stone fluted Corinthian pilasters, and topped by a scrollwork pediment. Large windows on either side of the entrance on the first floor are topped by similar pediments.