Vocalization-associated respiration patterns: thermography-based monitoring and detection of preparation for calling

Abstract

Vocal emission requires coordination with the respiratory system. Monitoring the increase in laryngeal pressure, needed for vocal production, allows detection of transitions from quiet respiration to vocalization-supporting respiration. Characterization of these transitions could be used to identify preparation for vocal emission and to examine the probability of it manifesting into an actual vocal production event. Specifically, overlaying the subject's respiration with conspecific calls can highlight events of call initiation and suppression, as a mean of signalling coordination and avoiding jamming. Here we present a thermal-imaging based methodology for synchronized respiration and vocalization monitoring of free ranging meerkats. The sensitivity of this methodology is sufficient for detecting transient changes in the subject's respiration associated with the exertion of vocal production. The differences in respiration are apparent not only during the vocal output but also prior to it, marking the potential time frame of the respiratory preparation for calling. A correlation between conspecific calls with elongation of the focal subject's respiration cycles could be related to fluctuations in attention levels or in the motivation to reply. This framework can be used for examining animals’ capability for enhanced respiration control during modulated and complex vocal sequences, detect “failed” vocalisation attempts and investigate the role of respiration cues in the regulation of vocal interactions.

ApeTI: A Thermal Image Dataset for Face and Nose Segmentation with Apes

“…These were chosen for their particularity of forming an arrow shape on the nose of the chimpanzee, making them easy to annotate. The nose area is also susceptible to changes when the subject is aroused [15] or breathing [16]. We began with these landmarks with the goal of extracting heart rate, breath rate, and arousal from their temperature changes over time.…”

“…Similarly, in [14], the temperature of the nose tip and forehead is observed to assess cognitive workload while driving. In nonhuman animals, the nose temperature is also observed for detecting arousal [15], breathing, and vocalization [16]. According to these studies, thermal imaging could provide deeper insights into the behavior and cognitive development of nonhuman animals.…”

Leveraging big data to uncover the eco-evolutionary factors shaping behavioural development

“…Internal state variables such as body condition can be estimated directly from video frames in the case of video tracking [53]. High-resolution physiological data can be obtained from a quickly expanding array of non-invasive biologging tools [54,55], such as heart rate monitors [56,57] or thermal imaging [58][59][60], and may help infer stress levels, respiration rate or energetic state when coupled with behavioural data. Other approaches use both supervised and unsupervised machine learning methods to infer underlying internal state variables from high-resolution behavioural tracking data themselves [61][62][63][64].…”

Neuropeptide Modulation Enables Biphasic Inter-network Coordination via a Dual-Network Neuron

“…Coordination can occur in multiple forms. Networks may express correlated changes in frequency or strength, as occurs in respiration to meet the demands of changing locomotor speeds, or at the onset of vocalizations (Anderson et al, 2016; Demartsev et al, 2022; Juvin et al, 2022; Ramirez and Baertsch, 2018). Coordination may also involve relative timing relationships, such as specific delays between movements of different body parts, or a regulated number of cycles of one behavior relative to another (Daley et al, 2013; Juvin et al, 2022; Mulloney and Smarandache-Wellmann, 2012; Wei et al, 2022).…”