Vocal effort, coordination, and balance

Abstract

Manipulating speaking and discourse requirements allows us to asses the time-varying correspondences between various subsystems within a talker at different levels of vocal effort. These subsystems include fundamental frequency (F0) and acoustic amplitude, rigid body (6D) motion of the head, motion (2D) of the body, and postural forces and torques measured at the feet. Analysis of six speakers has confirmed our hypothesis that as vocal effort increases coordination among sub-systems simplifies, as shown by greater correspondence (e.g., the instantaneous correlation) between the various time-series measures. However, at the two highest levels of vocal effort, elicited by having talkers shout to and yell at someone located appropriately far away, elements of the postural force, notably one or more torque components, often show a reduction in correspondence with the other measures. We interpret this result as evidence that talkers become more rigidly coordinated at the highest levels of vocal effort, which can interfere with their balance. Furthermore, the discourse type—shouting at someone to carry on a conversation vs. yelling at someone not expected to reply—can be associated with differing amounts of imbalance.

Quantitative analysis of multimodal speech data

“…In the results section below, we qualitatively discuss the occurrence of two individual manual movements and their respective relationships to accompanying speech, one of which occurs in the demo task, and the other of which occurs in the pref task. The correlation matrix produced by CMA is also used to produce a quantitative measure, which is the probability that the two signals’ correlation is above a threshold value ( ρ =0.5), normalized by the length of a trial (Fuhrman, 2014). We refer to this measure as PrPosCorr, the Pr obability of above-threshold Pos itive Corr elation between the two signals of interest.…”