Baugh Fell is bounded by Garsdale to the south and by the valley of the River Rawthey to the west; on the north-eastern side it adjoins Swarth Fell and Wild Boar Fell. The fell sprawls over a wide area, roughly in size, with generally steep slopes on the Garsdale side and gentler slopes to the west. The Rawthey rises high up on the summit plateau (where it is called Rawthey Gill) and initially flows north, before turning south to form the hill's western boundary. The eastern limit of the fell is marked by Grisedale Beck, the main tributary of the Clough River which flows through Garsdale.