Bayville, New York
The village wasn't named "Bayville" until 1859.  Before that, the village had two names.  The western and middle parts were called "Oak Neck". The eastern part was called "Pine Island".