Born in the village of Pitelli near La Spezia, Scelsi spent most of his time in his mother's old castle where he received education from a private tutor who taught him Latin, chess and fencing. Later, his family moved to Rome and his musical talents were encouraged by private lessons with Giacinto Sallustio. In Vienna, he studied with Walther Klein, a pupil of Arnold Schoenberg. He became the first exponent of dodecaphony in Italy, although he did not continue to use this system.