In September 1873, Byrne was in court for taking a neighbour, Anton Wick's horse. He had ridden it for several days before bringing it back. He had to pay a fine of 20 shillings. In December 1875, he was in court again for taking a saddle, but the court believed Byrne when he said he had found it in the bush. On May 20, 1876, Joe Byrne and his friend, Aaron Sherritt, stole a cow and cut it up for the meat. Someone saw them and told the police. They were taken to court and given six months in the Beechworth Gaol. In prison, Byrne and Sherritt met Jim Kelly, who was the brother of Ned and Dan Kelly. Joe Byrne met Ned Kelly in 1876 and they became friends.