Minor internal alterations were carried out on Fernberg in the mid 1940s after a change of Governor and in anticipation of visits by various members of the Royal Family (Prince Henry, Duke of Gloucester having been appointed as Governor-General of Australia in January 1945). Pressure for additional accommodation for the Governor's private staff in the late 1940s resulted in the construction of a single storied brick Auxiliary Building. This building replaced the earlier timber building that had been relocated onto the site in 1910 and was subsequently moved to another site in Bardon. In 1950 a brick administration building and a new coverway with port cochere were erected. The entire complex was painted white at this time.