In recent decades, male infertility has been correlated with the shortening of sperm telomeres. Telomeres regulate the reproductive lifespan by mediating the synapsis and homologous recombination of chromosomes during gametogenesis. They are composed of thousands of hexanucleotide DNA repeats (TTAGGG) that are coupled to specialized shelterin complex proteins and non-coding RNAs. Telomerase activity in male germ cells ensures that the telomere length is maintained at maximum levels during spermatogenesis, despite telomere shortening due to DNA replication or other genotoxic factors such as environmental pollutants. An emerging body of evidence has associated an exposure to pollutants with male infertility. Although telomeric DNA may be one of the important targets of environmental pollutants, only a few authors have considered it as a conventional parameter for sperm function. The aim of this review is to provide comprehensive and up-to-date data on the research carried out so far on the structure/function of telomeres in spermatogenesis and the influence of environmental pollutants on their functionality. The link between pollutant-induced oxidative stress and telomere length in germ cells is discussed.