Castle
The powerful people who built castles also lived in them with their families. They would have servants and a group of people to make sure the castle worked: people fetching water, cooking,  clearing the stables, looking after animals, cooking, lighting fires, and checking who was coming into the castle. In peacetime, most castles only had a few soldiers who would guard the place.