Bayley was the couple's first child, born at their home at 65 Chambers Street, New York City on August 23, 1814, and baptized at Trinity Church on September 21. A brother Richard was born on October 25, 1816 while the family was living at 331 Pearl Street, beside Grandfather Roosevelt's place of business at 333 Pearl Street. The following year, Dr. Bayley, probably desiring more healthful surroundings for his family than the city, purchased three pieces of land in Mamaroneck in Westchester County, and the family made their new home on one of these, a fifty-acre plot known as Nelson Hill. In this home, three other children were born: Carleton in November 1818, William Augustus in May 1821, and the only daughter, Maria Eliza, on March 1, 1823.