In time, Fort St. Joseph became an important point for trade and commerce in the region, receiving vessels and their goods from Detroit, Mackinac and Sault Ste. Marie. Settlers, many of whom had lived near the fort at Mackinac as well as merchants of the Northwest Company followed the garrison to establish the first permanent European settlement on the island around Fort St. Joseph. However, conditions at the fort and settlement were grim for soldiers and settlers alike, particularly in the winter months. The commandant, Lieutenant Robert Cowell complained to his superiors that all the fort's buildings were drafty and susceptible to snow and rain. A fire in January 1802 destroyed the bakehouse; the other buildings were saved by villagers and soldiers fighting the flames. Desertions were a frequent occurrence, with soldiers recovered having frozen to death, or requiring amputation of frost-bitten limbs.