The Wistert brothers grew up on the northwest side of Chicago and were the sons of a Lithuanian family. Their father was a Spanish-American War veteran, who later died while working for the Chicago Police Department. Brother Alvin Wistert said that their father, "was born Casmir Vistertus and he Anglicized it when he came to America to Wistert." 