Cement based composite materials (CBCM) with superior mechanical strength and excellent durability are always desirable in practical applications. Although considerable research has been reported in the past decades about the use of Nano materials (NMs) for strength and durability enhancement of cement matrix, there is little information available on the use of graphene nano-sheets and their derivatives (GND) in cement-based materials. Particularly the role of GND in hydration processes and their mechanisms of strengthening in cement matrix are unclear. In this paper, a critical review on recent research findings about GND modified cement-based materials was conducted. The review mainly discussed the influence of GND on properties of cement matrix including microstructure, hydration, mechanical properties, etc. The information revealed in this paper would not only provide a comprehensive understanding of the effect of GND on cement composites, but also provide valuable ideas and guidance for similar studies in the future.