Mosby began his education at a school called Murrell's Shop. When his family moved to Albemarle County, Virginia (near Charlottesville) in about 1840, John attended school in Fry's Woods before transferring to a Charlottesville school at the age of ten years. Because of his small stature and frail health, Mosby was the victim of bullies throughout his school career. Instead of becoming withdrawn and lacking in self-confidence, the boy responded by fighting back. The editor of his memoirs recounted a statement Mosby made that he never won any fight in which he was engaged. The only time he did not lose a fight was when an adult stepped in and broke it up.