In June 1866, having passed out from Sandhurst, Goldsmid was commissioned into the 104th Foot. He became adjutant of battalion in 1871, captain in May, 1878, major in 1883, lieutenant-colonel in 1888, and colonel on 21 April 1894. In 1892 Colonel Goldsmid was selected by Baron de Hirsch to supervise the Jewish colonies in Argentina, but retired from the task to take up his appointment as colonel-in-command of the Welsh regimental district at Cardiff in 1894. In 1897 he was promoted chief of staff, with the grade of assistant adjutant-general in the Thames district.