Sexuality is the main strategy for maintaining genetic diversity within a species. In flowering plants (angiosperms), sexuality is derived from ancestral hermaphroditism and multiple sexualities can be expressed in an individual. The mechanisms conferring chromosomal sex determination in plants (or dioecy) have been studied for over a century by both biologists and agricultural scientists, given the importance of this field for crop cultivation and breeding. Despite extensive research, the sex determining gene(s) in plants had not been identified until recently. In this review, we dissect plant sex evolution and determining systems, with a focus on crop species. We introduced classic studies with theoretical, genetic, and cytogenic approaches, as well as more recent research using advanced molecular and genomic techniques. Plants have undergone very frequent transitions into, and out of, dioecy. Although only a few sex determinants have been identified in plants, an integrative viewpoint on their evolutionary trends suggests that recurrent neofunctionalization events are potentially common, in a “scrap and (re)build” cycle. We also discuss the potential association between crop domestication and transitions in sexual systems. We focus on the contribution of duplication events, which are particularly frequent in plant taxa, as a trigger for the creation of new sexual systems.