 His family moved to Medford, Oregon going into his senior year in order to lessen his mother's commute to work.Following the move, Brown attended North Medford High School and was named first team All-Southwest Conference and second team OSAA Class 6A All-State as a senior.Both at North Medford and for the Medford Mustangs in American Legion, Brown was a teammate of Major League pitcher Braden Shipley.