In 1841 Leslie and his wife traveled from Sydney to Brisbane aboard the Hunter River Steam Navigation Company steamer, "Shamrock". They were then counted as the first family to make the journey from Brisbane to the Darling Downs. By 1841 the Leslies had sold their interest in 'Toolburra' and moved to 'Canning Downs' which was managed by George and Walter Leslie. When the Leslies first settled on Canning Downs, they had 6000 sheep, two teams of bullocks and drays, one team of horses and a dray, 10 saddle horses, and 22 convict employees. The task of building up the property during a time of depression proved too difficult and Patrick Leslie was ruined financially by 1844.