In his autobiography, "I, Me, Mine", Harrison comments only briefly on "That Is All", saying: "The melody came to me and I then had to think of lyrics. That's all." Commentators have remarked on how, like many other Harrison compositions – "Long, Long, Long", "Something", "What Is Life", "Don't Let Me Wait Too Long", "Learning How to Love You" and "Your Love Is Forever" among them – it serves as both a conventional love song to a woman and a declaration of devotion to God. Harrison said in a 1976 interview: "I think all love is part of a universal love. When you love a woman, it's the God in her that you see."