Only Fenner an' some of the train guards ridin' in spoiled their game." 
Some of the train guards riding in and Fenner were the only ones who spoiled their game.
Train guards and Fenner were only few of those who wanted to spoil their game.