After 1035 Roger seems to have lost favor with the young duke William. He signed an early charter of Duke William simply as 'Roger of Montgomery'. He apparently was no longer the viscount. In 1037 when rebellions broke out, Roger was one of the rebels. When he was defeated he fled to the court of Henry I of France. Roger was forced into exile by Osbern the Steward. Osbern was later killed by William de Montgomery, Roger's son. Where and when Roger died is unknown. In 1068 his wife was still holding lands at Bures and Saint-Pair.