James was born in Esher, Surrey. Her father, James Thomson, died of cancer in 2008. She took her father's given name as her stage name when she learnt of an actress also named Lily Thomson. She has dated actor Matt Smith since 2014.