Fremantle was the son of John Fremantle, of Aston Abbots, Buckinghamshire, by his wife Frances Edwards, daughter of John Edwards, of Bristol.
Fremantle was the child of John Fremantle from Aston Abbots in Buckinghamshire, born to his wife Frances Edwards, who came from a family in Bristol.