Ruthven was born in Sacramento, California and attended Irvington High School in Fremont, California. He was drafted out of high school by the Baltimore Orioles in the 20th round of the 1969 Major League Baseball draft but, enrolled at the California State University, Fresno. The Philadelphia Phillies drafted him in the secondary phase of the 1st round of the 1973 Major League Baseball draft. Ruthven made his major league debut with the Phillies on April 17, 1973 at the age of 22.