The word "Limaye" actually means "a sailor" in Hebrew "לימאי", which could lend credence to this hypothesis.
The Chitpavan Brahmins story of shipwrecked people is similar to the legendary arrival of Bene Israel Jews in the Raigad district.