The Oaks was called simply "Oaks" until 1895. An expedition was undertaken in 1795 which included Governor Hunter and George Bass, due to the sighting of some cows which had strayed from the Government Farm at Farm Cove. The herd had increased from 8 to around 40 and the area they were found in was then named "Cow Pasture Plains". Until 1822, it was forbidden to settle in the region although it was noted as being an excellent area for cultivation as a succession of governors sought to protect the herd from exploitation or molestation as an investment in the colony's future.