Embodiments, visualizations, and immersion with enactive affective systems

Abstract

Our proposal in Bioart and Biomedical Engineering for affective esthetics focuses on the expanded sensorium and investigates problems regarding enactive systems. These systems enhance the sensorial experiences and amplify kinesthesia by adding the sensations that are formed in response to the physical world, which aesthetically constitutes the principle of synaesthesia. In this paper, we also present enactive systems inside the CAVE, configuring compelling experiences in data landscapes and human affective narratives. The interaction occurs through the acquisition, data visualization and analysis of several synchronized physiological signals, to which the landscapes respond and provide immediate feedback, according to the detected participants' actions and the intertwined responses of the environment. The signals we use to analyze the human states include the electrocardiography (ECG) signal, the respiratory flow, the galvanic skin response (GSR) signal, plantar pressures, the pulse signal and others. Each signal is collected by using a specifically designed dedicated electronic board, with reduced dimensions, so it does not interfere with normal movements, according to the principles of transparent technologies. Also, the electronic boards are implemented in a modular approach, so they are independent, and can be used in many different desired combinations, and at the same time provide synchronization between the collected data.

Enactive Systems & Computing Mapping the terrain for Human-Computer Interaction research

“…The topics of the papers are more dispersed and it was possible to identify 53 different subjects, with a slight concentration for the modeling of emotions, for virtual reality, for autonomous and conscious cognitive systems, and for different types of interfaces (Table 6). Analyzing the list of keywords found in the selected papers (Figure 8), it is possible to notice that the more frequent terms are exactly the principal terms of this review, but with no relationship between them, except for the paper by Domingues et al (2014) that presents the keyword "enactive systems". Among the other keywords, is noteworthy the wide presence of the term "learning" and the less obvious presence of the terms "creativity" and "design".…”

A Comprehensive Study of Emotional Responses in AI-Enhanced Interactive Installation Art

“…Dominguez-Jimenez proposes a machine-learning model for emotion recognition from physiological signals using the Bagged Trees algorithm to recognize facial emotions from RGB data collected using an RGB HD camera [82]. Ratliff discusses a framework for recognizing emotions using facial expressions through machine-learning techniques based on still images of the face using active appearance models [83].…”

Understanding and designing sociotechnical scenarios: a multi-theoretical approach

“…Instead, Enactivism proposes cognition and environment are seen as inseparable: the external objects are delineated and the knowledge about them are internalized as a single phenomenon, driven by loops of action and reaction involving the mind and the world. This idea was translated by Kaipainen et al [27] into the concept of enactive systems, i.e., systems that create feedback loops using sensors and actuators, coupling to the sensorimotor apparatus of the users, as it exchanges energies and signals with the environment [17], as in the enactive condition described by Varela et al [56]. Enactive systems have no core abstraction of the environment; the world itself is the representation, being continually sensed to regulate internal processes of the system.…”