Baldwin was the oldest son of Baldwin V, Count of Flanders and Adela of France. Adela was a daughter of king Robert II of France. and Constance of Arles. He was also the brother of Matilda of Flanders, Queen consort of England and wife of William the Conqueror, King of England.