Although the late 1920s saw a short-lived building boom before the Great Depression, the population remained in the hundreds through World War II. But the village dramatically grew during the post-war boom with the population increasing from 1,180 in 1940 to 7,939 in 1970, a nearly seven-fold increase. The village also gained territory in 1954, when Bayside, Fox Point, Glendale, and River Hills agreed to annex what remained of the Town of Milwaukee to prevent the City of Milwaukee from expanding across northeastern Milwaukee County. Since the 1970s, the village population has slowly yet consistently declined.