Considerable research exists on the life history traits, evolutionary history, and environmental factors that shape the population genetic structure of marine organisms, including sharks and rays. Conservation concerns are particularly strong for this group as they are highly susceptible to anthropogenic stressors due to a combination of life history traits including late maturity and low fecundity. Here, we provide a review and synthesis of the global phylogeography of sharks and rays. We examined existing data for 40 species of sharks belonging to 17 genera and 19 species of rays belonging to 11 genera. Median joining haplotype networks were constructed for each species for the mtDNA cytochrome C oxidase subunit I (COI), and an Analysis of Molecular Variance (AMOVA) was conducted to understand patterns of genetic diversity and structure across the three major ocean basins—the Indian, Atlantic and Pacific Oceans. Haplotype networks showed very shallow coalescence in most species, a finding previously reported for marine teleosts. Star topologies were predominant among sharks while complex mutational topologies predominated among rays, a finding we attribute to extremely limited dispersal in the early life history of rays. Population structuring varied amongst species groups, apparently due to differences in life history traits including reproductive philopatry, site fidelity, pelagic habitat, migratory habits, and dispersal ability. In comparison to reef-associated and demersal species, pelagic and semi pelagic species showed lower levels of structure between and within ocean basins. As expected, there is variation between taxa and groups, but there are also some broad patterns that can guide management and conservation strategies.