Graphene oxide-based materials (GOBMs) have been widely explored as nano-reinforcements in cementitious composites due to their unique properties. Oxygen-containing functional groups in GOBMs are crucial for enhancing the microstructure of cementitious composites. A better comprehension of their surface chemistry and mechanisms is required to advance the potential applications in cementitious composites of functionalized GOBMs. However, the mechanism by which the oxygen-containing functional groups enhance the response of cementitious composites is still unclear, and controlling the surface chemistry of GOBMs is currently constrained. This review aims to investigate the reactions and mechanisms for functionalized GOBMs as additives incorporated in cement composites. A variety of GOBMs, including graphene oxide (GO), hydroxylated graphene (HO-G), edge-carboxylated graphene (ECG), edge-oxidized graphene oxide (EOGO), reduced graphene oxide (rGO), and GO/silane composite, are discussed with regard to their oxygen functional groups and interactions with the cement microstructure. This review provides insight into the potential benefits of using GOBMs as nano-reinforcements in cementitious composites. A better understanding of the surface chemistry and mechanisms of GOBMs will enable the development of more effective functionalization strategies and open up new possibilities for the design of high-performance cementitious composites.