Carbon fiber-reinforced polymer (CFRP) composites have been widely used in civil engineering structures due to their excellent mechanical and durability properties. The harsh service environment of civil engineering leads to significant degradation of the thermal and mechanical performances of CFRP, which then reduces its service reliability, service safety, and life. Research on the durability of CFRP is urgently needed to understand the long-term performance degradation mechanism. In the present study, the hygrothermal aging behavior of CFRP rods was investigated experimentally through immersion in distilled water for 360 days. The water absorption and diffusion behavior, the evolution rules of short beam shear strength (SBSS), and dynamic thermal mechanical properties were obtained to investigate the hygrothermal resistance of CFRP rods. The research results show that the water absorption behavior conforms to Fick’s model. The ingression of water molecules leads to a significant decrease in SBSS and glass transition temperature (Tg). This is attributed to the plasticization effect of the resin matrix and interfacial debonding. Furthermore, the Arrhenius equation was used to predict the long-term life of SBSS in the actual service environment based on the time–temperature equivalence theory, obtaining a stable strength retention of SBSS of 72.78%, which was meaningful to provide a design guideline for the long-term durability of CFRP rods.