The size of seeds is particularly important for agricultural development, as it is a key trait that determines yield. It is controlled by the coordinated development of the integument, endosperm, and embryo. Large seeds are an important way of improving the ultimate “sink strength” of crops, providing more nutrients for early plant growth and showing certain tolerance to abiotic stresses. There are several pathways for regulating plant seed size, including the HAIKU (IKU) pathway, ubiquitin–proteasome pathway, G (Guanosine triphosphate) protein regulatory pathway, mitogen-activated protein kinase (MAPK) pathway, transcriptional regulators pathway, and phytohormone regulatory pathways including the auxin, brassinosteroid (BR), gibberellin (GA), jasmonic acid (JA), cytokinin (CK), Abscisic acid (ABA), and microRNA (miRNA) regulatory pathways. This article summarizes the seed size regulatory network and prospective ways of improving yield. We expect that it will provide a valuable reference to researchers in related fields.