Sepsis-associated acute kidney injury (SA-AKI) results in significant morbidity and mortality, and ferroptosis may play a role in its pathogenesis. Our aim was to examine the effect of exogenous H2S (GYY4137) on ferroptosis and AKI in in vivo and in vitro models of sepsis and explore the possible mechanism involved. Sepsis was induced by cecal ligation and puncture (CLP) in male C57BL/6 mice, which were randomly divided into the sham, CLP, and CLP + GYY4137 group. The indicators of SA-AKI were most prominent at 24 h after CLP, and analysis of the protein expression of ferroptosis indicators showed that ferroptosis was also exacerbated at 24 h after CLP. Moreover, the level of the endogenous H2S synthase CSE (Cystathionine-γ-lyase) and endogenous H2S significantly decreased after CLP. Treatment with GYY4137 reversed or attenuated all these changes. In the in vitro experiments, LPS was used to simulate SA-AKI in mouse renal glomerular endothelial cells (MRGECs). Measurement of ferroptosis-related markers and products of mitochondrial oxidative stress showed that GYY4137 could attenuate ferroptosis and regulate mitochondrial oxidative stress. These findings imply that GYY4137 alleviates SA-AKI by inhibiting ferroptosis triggered by excessive mitochondrial oxidative stress. Thus, GYY4137 may be an effective drug for the clinical treatment of SA-AKI.