Thermoset glass fiber-reinforced polymers (GFRP) have been widely used in manufacturing and construction for nearly half a century, but the large amount of waste produced by this material is difficult to dispose of. In an effort to address this issue, this research investigates the reuse of thermoset GFRP waste in normal strength concrete (NSC) and controlled low-strength materials (CLSM). The mechanical performance and workability of the resulting concrete were also evaluated. To prepare the concrete specimens, the thermoset GFRP waste was first pulverized into granular pieces, which were then mixed with cement, fly ash, and water to form cylindrical concrete specimens. The results showed that when the proportion of thermoset GFRP waste aggregate in the concrete increased, the compressive strengths of NSC and CLSM would decrease. However, when incorporating 5% GFRP waste into CLSM, the compressive strength was 7% higher than concrete without GFRP. However, the workability of CLSM could be improved to meet engineering standards by adding an appropriate amount of superplasticizer. This finding suggests that the use of various combinations of proportions in the mixture during production could allow for the production of CLSM with different compressive strength needs. In addition, the use of recycled thermoset GFRP waste as a new aggregate replacement for traditional aggregates in CLSM was found to be a more sustainable alternative to the current CLSM combinations used in the market.