Walker's entrance into professional baseball caused immediate friction in the league. Before he had the opportunity to appear in a game, the executive committee of the Northwestern League debated a motion proposed by the representative of the Peoria, Illinois club that would prohibit all colored ball players from entering the league. After intense arguments, the motion was dropped, allowing Walker to play. On August 10, 1883, in an exhibition against the Chicago White Stockings, Chicago's manager Cap Anson refused to play if Walker was in the lineup. In response, Charlie Morton, who replaced Voltz as Toledo's manager at mid-season, challenged Anson's ultimatum by not only warning him of the risk of forfeiting gate receipts, but also by starting Walker at right field. Anson is alleged to have said “We’ll play this here game, but won’t play never no more with the nigger in”. The White Stockings won in extra innings 7–6.