Grain size is one of the major traits that determine rice grain yield and quality. TheGS3gene is the first major quantitative trait locus (QTL) that was identified in regulating rice grain length and weight. It was reported that thegs3allele with a mutation in the organ size regulation (OSR) domain of theGS3protein produced longer grains. In this study, we used the CRISPR/Cas9 gene editing technology to introduce an editedgs3allele into ourindicamaintainer line, Mei1B, to enhance its grain yield and quality. Through molecular analysis and sequencing, a homologous edited-gs3mutant line without any transgene was obtained in the T1generation and was named Mei2B. A superior male sterile line Mei2A was generated by backcrossing the cytoplasmic male sterile (CMS) line Mei1A with Mei2B. Mei2B had a higher grain quality and yield compared to its wild-type Mei1B. Its grain length increased by 7.9%, its length/width ratio increased from 3.89 to 4.19, TGW increased by 6.7%, and grain yield per plant increased by 14.9%. In addition, genetic improvement of other quality traits including brown rice length (6.83 mm), brown rice grain length/width ratio (3.61), matched the appearance standards set for traditional Simiao (silk seedling) type cultivars. Two restorer lines were outcrossed to both Mei1A and Mei2A to produce hybrid rice. Compared to two hybrids of Mei1A, the hybrids of Mei2A had longer grains, higher length/width ratio, TGW, and yield per plant. In addition, the hybrids of Mei2A showed a better grain appearance including better translucency, a lower chalky rice rate, and degree of chalkiness than the hybrids of Mei1A. These results demonstrated that the introduction of an elitegs3allele into Mei1A via CRISPR/Cas9 gene editing technology led to significant genetic improvement of the rice grain. The resultant CMS line Mei2A(gs3) displayed much higher grain quality and yield than the original Mei1A. Therefore, our study demonstrated that the targeted genetic improvement via gene editing technology can enhance rice breeding, especially the breeding of three-line hybrid rice.Supplementary InformationThe online version contains supplementary material available at 10.1007/s11032-022-01290-z.