This paper proposes that the perceptual and cognitive mechanisms involved when listening to certain genres within “sound-based” music, such as post-spectralism, glitch-electronica, and electroacoustic music and in various areas of sound art, are best understood within a connectionist cognitive framework described by morphodynamic theory. By analysing the specific characteristics of sound-based music, it is explored how this kind of music works at perceptual and cognitive levels. The sound patterns found in these pieces engage listeners more readily at a phenomenological level rather than through establishing long-term conceptual associations. They consist of a set of geometries in motion appearing to the listener as “image schemata”, as they embody Gestalt and kinaesthetic principles portraying the forces and tensions of our being in the physical world (e.g., figure-background, near-far, superimposition, compulsion, blockage). In applying morphodynamic theory to the listening process involved in this kind of music, this paper discusses the results of a listening survey designed to investigate the functional isomorphism between sound patterns and image schemata. The results suggest that this music can be seen as a mean term within a connectionist model between the acoustic-physical world and the symbolic level. This original perspective opens up new pathways to access this kind of music and leads to a more general understanding of today’s modes of listening.