The school is located in central Bristol, near Cabot Tower, in a building built of Brandon stone, designed by local architects Foster and Son and dating from 1847. It has been designated by English Heritage as a grade II listed building. The terrace steps and walls are also grade II listed, as are the walls, lodge and gates. Before moving to the site on Brandon Hill, it was previously housed at Gaunt's Hospital mansion house, Unity Street (1590–1767) and St. Bartholomew's, Christmas Steps (1767–1847). QEH has had close associations with Redmaids' High School since the latter's founding in 1634.