The key was always known locally as Pacet Key and was given the name Little Duck Key during the construction of the Overseas Railroad.
The name "Pacet Key" was used locally before it was changed to "Little Duck Key" when the Overseas Railroad was being built.