On the north-west side of the gardens (on Mill Lane) stands a two-storey building dating from 1822. This was built as a school for the poorhouse, with boys on one floor and girls on the other. This was the first free education provided to females in this area. It was replaced by a new pair of schools (one for girls one for boys) further along Mill Lane, in 1838. These were built by Sir John Gladstone of Leith, William Gladstone's father. This connection led to the first-mentioned ex-school being named "Gladstones".