Lilly has three children from her marriage to Peter: Peter, Minnie, and Liza. Peter lives in Bridgehampton, New York, with his wife, Elise, and five children: Fiona, Caleb, Stefan, Aaron, and Daniella. Liza currently lives in West Palm Beach, Florida, with her husband, Henry, and three children: Waverly, Hattie and Rayna. Liza is currently helping out in Florida with the Lilly Pulitzer Brand.