This article aims to describe the process of measuring mental state variables through a brain-computer interface in the interaction of humans with books with augmented reality; specifically, it seeks to analyze the variables commitment, stress, interest, relaxation, excitement, concentration in the interaction of students with a book with augmented reality compared with the measurement of the same variables when reading a traditional text. For the process of measuring emotional signals, two texts were designed for the data structure subject of the systems engineering program, the first in traditional format and the second with augmented reality applications. Subsequently, the mental state measures were taken through the brain-computer interface to the sample of students of the subject interacting with the traditional book and the book with augmented reality. Finally, through the interface software application, the results of the variables of each student interacting with the mentioned texts were downloaded and comparatively analyzed. Through comparative analysis, it is shown that the variable of mental state interest increases in the interaction of higher education students with books with augmented reality compared to reading a traditional text. Brain-computer interface systems have become an effective strategy for the measurement of emotional variables in the incorporation of emerging technologies such as augmented reality into teaching-learning processes in higher education.