Even if cement is a well-consolidated material, the chemistry of cement (and the chemistry inside cement) remains very complex and still non-obvious. What is sure is that the hydration mechanism plays a pivotal role in the development of cements with specific final chemical compositions, mechanical properties, and porosities. This document provides a survey of the chemistry behind such inorganic material. The text has been organized into five parts describing: (i) the manufacture process of Portland cement, (ii) the chemical composition and hydration reactions involving a Portland cement, (iii) the mechanisms of setting, (iv) the classification of the different types of porosities available in a cement, with particular attention given to the role of water in driving the formation of pores, and (v) the recent findings on the use of recycled waste materials in cementitious matrices, with a particular focus on the sustainable development of cementitious formulations. From this study, the influence of water on the main relevant chemical transformations occurring in cement clearly emerged, with the formation of specific intermediates/products that might affect the final chemical composition of cements. Within the text, a clear distinction between setting and hardening has been provided. The physical/structural role of water in influencing the porosities in cements has been analyzed, making a correlation between types of bound water and porosities. Lastly, some considerations on the recent trends in the sustainable reuse of waste materials to form “green” cementitious composites has been discussed and future considerations proposed.