The thermal stability of gypsum-based materials, and in this context, especially their long-term behavior, is the background of our current research activities. A comprehensive investigation program was compiled in which detailed examinations of various model materials exposed to thermal loads were carried out. The understanding of the partly not entirely consistent state of knowledge shall be sharpened especially by in situ observations of the thermally induced conversion reaction of gypsum into hemihydrate. The temporal course of the reaction was investigated non-destructively by in situ investigations in a high-resolution X-ray computed tomography setup, and the experiment was accompanied by detailed characterizations of the microstructure and composition. In this contribution, selected results of experiments with a high-purity natural gypsum rock as the model substance are presented. Studying the influence of temperature on the reaction showed that, even under supposedly dry conditions, the reaction could take place at much lower temperatures than usually reported in the literature. It was demonstrated that the transformation of gypsum into hemihydrate could take place at a temperature of already 50 °C. The results indicated that even under “classical” heating conditions in a conventional oven, the dissolution and crystallization processes in water films on the mineral surfaces could be suggested to be a driving force for the reaction. A corresponding reaction model, which took these aspects into account, was proposed in this work.