The Union army attacked Carthage in 1864. The Shirleys moved to Scyene, Texas. Legend says that the Shirleys knew a number of Missouri-born criminals, including Jesse James and the Youngers. Starr knew the Younger brothers and the James boys because she had grown up with them in Missouri. People thought that Starr's brother Bud was in favor of the Confederate States of America. He was killed in 1864 by Union troops.