No abstract

No abstract

HAL is a multi-disciplinary open access archive for the deposit and dissemination of scientific research documents, whether they are published or not. The documents may come from teaching and research institutions in France or abroad, or from public or private research centers. L'archive ouverte pluridisciplinaire HAL, est destinée au dépôt et à la diffusion de documents scientifiques de niveau recherche, publiés ou non, émanant des établissements d'enseignement et de recherche français ou étrangers, des laboratoires publics ou privés.

In this paper, we investigate new ways to understand and to analyze human gesture in a research context applied on co-verbal gesture across language. The research project focuses on the quality of the movement and consider the gesture "pulse of effort." We propose a workflow for real-time gesture analysis to visualize gesture kinematics features (Velocity, Acceleration, Jerk) from heterogeneous data (Video, Motion Capture and Gesture Annotations) at the same time base. The tools designed here provide immersive and interactive explorations of data: users can test hypotheses and embody gesture visualization and descriptors adopting different Frames of Reference using augmented reality. We have conducted an evaluation protocol in the field of linguistics that compares 496 annotated gestures to benchmark the workflow. CCS CONCEPTS• Human-centered computing → Visualization • Applied computing → Arts and humanities → Language translation

In this tribute to Dominique Boutet and the kinesiological approach he founded, the authors have tried to make their memories of the scientific collective projects they worked on together resonate with the written work of this extraordinary scientific partner, gathered in his published articles and his habilitation document (Boutet 2018). His approach based on an intimate knowledge of the biomechanics of the human body is centered on the structuring role of the body in gestures (and signed languages). It is form-based: the form of gestures shapes their meaning or function. Gestural units are described on the basis of their formal characteristics and physiological constraints rather than their imagistic iconicity. The article presents the foundations of the approach, a synoptic description and some examples of its application. The originality of the kinesiological approach lies in the double revolution that it allows us to operate: on the one hand, gesture is not simply an appendix of speech; on the other hand; it is shaped by bodily physiology. The approach is based on the movements of the human body analyzed from a biomechanical point of view. The meaning of our gestural productions is the produce of our body, as it is naturally articulated, imprinted as it is by our past experiences.