The availability of thermochemical properties allows for the prediction of the equilibrium compositions of chemical reactions. The accurate prediction of these can be crucial for the design of new chemical synthesis routes. However, for new processes, these data are generally not completely available. A solution is the use of thermochemistry calculated from first-principles methods such as Density Functional Theory (DFT). Before this can be used reliably, it needs to be systematically benchmarked. Although various studies have examined the accuracy of DFT from an energetic point of view, few studies have considered its accuracy in predicting the temperature-dependent equilibrium composition. In this work, we collected 117 molecules for which experimental thermochemical data were available. From these, we constructed 2648 reactions. These experimentally constructed reactions were then benchmarked against DFT for 6 exchange–correlation functionals and 3 quality of basis sets. We show that, in reactions that do not show temperature dependence in the equilibrium composition below 1000 K, over 90% are predicted correctly. Temperature-dependent equilibrium compositions typically demonstrate correct qualitative behavior. Lastly, we show that the errors are equally caused by errors in the vibrational spectrum and the DFT electronic ground state energy.