In his memoirs, Halme cites living his childhood in a broken family. His father had left his family when Tony was only six months old, with his elder brother - who was five years older than Tony - taking role of his childhood father figure. Halme said he had heard from his father only a couple of times since. The mother of the family was alcoholic and her male friends changed frequently. Even as an adult, Halme considered his brother to be his only true friend.