In 1989 he started the rock band Red House Painters. In 1992 the band were signed to 4AD. In 2000 Kozelek released his first solo EP "Rock 'n' Roll Singer". "Pitchfork" gave it a score of 6.1 out of 10. In 2001 Red House Painters broke up. In 2002 Kozelek started Sun Kil Moon.