The name is the plural form of borg which means "castle" or "hill/plateau suitable for a castle".
In the context of architecture, the plural term "borg" refers to both "castle" and "hill/plateau suitable for a castle."