Highland Beach was founded in summer 1893 by Maj. Charles Remond Douglass, (Frederick Douglass' son) and his wife, Laura, after they had been turned away from a restaurant at the nearby Bay Ridge resort because of their race. Charles Douglass was a retired military officer who served with the 54th Massachusetts Infantry Regiment of the United States Colored Troops during the American Civil War. After being turned away, Maj. Douglass decided to buy beachfront property directly south of Bay Ridge and sell lots to family and friends.