In June 1885, the regiment was relocated to the South Cavalry Barracks at Aldershot, where the Prince of Wales' eldest son, Prince Albert Victor, joined the regiment and thereafter the Prince of Wales and his other son, Prince George, became frequent visitors. Byng struck up a friendship with both Albert Victor and George, but did not socialise with them much outside of army circles. Byng was appointed as the regimental adjutant on 20 October 1886, only nine days before the death of his father, who left Byng a watch and £3,500. The regiment then moved again in 1887 to the barracks at Hounslow, where, after suspecting that contractors were selling him inferior meat, Byng spent several early mornings at the Smithfield market to learn the meat trade, eventually proving his case and having the contractors changed. It was also at this time that Byng became acquainted with the Lord Rowton, who, along with the Guinness Trust, was trying to improve housing for skilled workers in London. Byng accompanied Rowton around the poorest areas of the city and suggested that retired senior soldiers from the rank-and-file be hired to maintain order in the Rowton Houses that Rowton had set up, thus starting a long-lived tradition.