The foundation for the group started in Kilsyth and the neighbouring village of Banton, when vocalist James Graham met guitarist Andy MacFarlane in high school and went on to form a cover band with some friends, which included drummer Mark Devine. After leaving school, they decided to take it more seriously. In late 2003, MacFarlane met bassist Craig Orzel in a bus stop and invited him to join the newly formed band. They took their name from a line in the poem "But I Was Looking at the Permanent Stars" by British poet Wilfred Owen, which reads "Sleep mothered them; and left "the twilight sad"."