At the age of thirteen, Brown took a job as a paperboy for the "Pittsburgh Courier", a black press paper, and developed a desire to pilot while reading in the newspaper about African-American aviators of the time including C. Alfred Anderson, Eugine Jacques Bullard, and Bessie Coleman. He also became an avid reader of "Popular Aviation" and the "Chicago Defender", which he later said heavily influenced his desire to fly naval aircraft. In his childhood he was described as "serious, witty, unassuming, and very intelligent." In 1937, he wrote a letter to U.S. President Franklin D. Roosevelt in which he complained of the injustice of African-American pilots being kept out of the U.S. Army Air Corps, to which the White House responded with a letter saying that it appreciated the viewpoint.