This idiom began as a comparison of "apples and oysters" in a book of proverbs published in 1670. This idiom has become a marker in English-speaking culture. Idioms are a common stumbling block for learners of a language.