A few troops in a castle could defend themselves against a much larger army. The most common method for taking a castle would be to besiege or storm it. Each had problems. Storming a castle would kill many of the attackers, but a siege would take a long time. Both methods sometimes failed.