Penny contributed to the operations of many community groups including The Melbourne Benevolent Asylum, The Cheltenham Mechanics Institute and The Moorabbin Rural Industries Association. In 1880 when it became obvious that the Victorian Benevolent Society property in North Melbourne was in need of replacement, the State Premier agreed in 1890 to grant land of 150 acres in Cheltenham to move the asylum to. In 1905 as a Councillor of the Shire, and a good Christian, Penny led the drive to get the project moving. Penny was involved in the Moorabbin Horticultural, Poultry and Dog Society for many years including serving as its vice president and President. Penny one of those responsible for the inauguration of the Society on 26 October 1898 in which he was elected as a vice president. Penny was also one of those committee members who drafted the rules and constitution for the club. On 24 July 1907, a deputation from the Horticultural Society including Penny met with the Minister of Agriculture asking for the establishment of a plot of land to use as an Experimental farm for growing of vegetables. It was agreed to set up a farm to grow produce used for scenting (perfumes etc.). In February 1909 the Horticultural society met to congratulate the fact the Scent farm was up and running and experts from the Department of Agriculture were present to talk to the market gardeners about the project. "(Caulfield and Elsternwick Leader Oct 29 1898 page 3)(Oakleigh Leader April 29, 1899 page 2)(Brighton Southern Cross Mar 14 1903 page 3)(The Age Feb 22 1904 page 9)(The Age July 25, 1907 page 9)(The Australasian Mar 14 1908 page 12)(Brighton Southern Cross Feb 20 1909 page 6)(Melbourne Leader – Kennel notes November 11, 1911 page 14)(Moorabbin News July 18, 1914 page 5)(Seaside News July 26, 1916 page 4)(Seaside News November 18, 1916 page 4)(The Age December 11, 1916 page 8)"