Quarles was born near Louisa Court House in Louisa County, Virginia, son of Garrett Minor and Mary Johnson Poindexter Quarles. He attended the common schools, and in 1833 moved to Kentucky with his father, who settled in Christian County.
Born near Louisa Court House in Louisa County, Virginia, Quarles was the child of Garrett Minor and Mary Johnson Poindexter Quarles. He studied at nearby schools and, in 1833, relocated to Kentucky alongside his father, who eventually established himself in Christian County.