He succeeded his father, William, sometime before 1129, possibly as early as 1116. A key portion of the family patrimony in Essex was in the King's hands. William had incurred a debt to the crown, perhaps in part due to a large fine levied by Henry I due to his displeasure at the escape of an important political prisoner when William was in charge of the Tower of London. The King also held the substantial estate of Geoffrey's maternal grandfather Eudo "le Dapifer" to which Geoffrey laid claim.