James Douglas was the oldest son of William, Lord of Douglas and Elizabeth Stewart. His father, William, had refused to support king Edward I of England who had taken over Scotland in 1290. The English king put William in prison and took his lands. This left young James with no land and no father. Douglas then went to France where he lived a simple life for three years. On hearing of his father's death he returned to Scotland and went to see William of Lamberton, Bishop of St. Andrews. The bishop took James in and in due time Bishop Lamberton took James to see King Edward I of England. When the bishop asked for the lands of Douglas to be returned to James, the king grew angry and said no. The lordship of Douglas had been given to Robert Clifford and the king would hear no more of the matter. Douglas remained in the service of the bishop and did nothing to rebel against the king of England. He hoped to get his family's lands returned to him. But in 1306 Robert the Bruce claimed the crown of Scotland as king Robert I. Now Douglas had a choice between two kings who might restore his lands.