Abnormal microbial colonization in the gut at an early stage of life affects growth, development, and health, resulting in short- and long-term adverse effects. Microbial colonization patterns of preterm infants differ from those of full-term infants in that preterm babies and their mothers have more complicated prenatal and postnatal medical conditions. Maternal complications, antibiotic exposure, delivery mode, feeding type, and the use of probiotics may significantly shape the gut microbiota of preterm infants at an early stage of life; however, these influences subside with age. Although some factors and processes are difficult to intervene in or avoid, understanding the potential factors and determinants will help in developing timely strategies for a healthy gut microbiota in preterm infants. This review discusses potential determinants of gut microbial colonization in preterm infants and their underlying mechanisms.