Hearing water temperature: Characterizing the development of nuanced perception of sound sources

Agrawal, Tanushree; Schachner, Adena

doi:10.1111/desc.13321

Cited by 5 publications

(4 citation statements)

References 116 publications

(175 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Early research on cue integration found that basic perception involves rapidly incorporating information from distinct sensory inputs (Ernst & Banks, 2002;Körding et al, 2007). In fact, people use multiple modalities to draw complex inferences about the structure of the environment and agents' behavior within it (Agrawal & Schachner, 2023;Gerstenberg et al, 2021;Schachner & Kim, 2018;Siegel et al, 2021). However, young children struggle with abstract multimodal inferences (Agrawal & Schachner, 2023;Gori et al, 2008;Outa et al, 2022) and models of adults have been limited to reasoning about physical events (e.g., Gerstenberg et al, 2021).…”

Section: Evidencementioning

confidence: 99%

“…In fact, people use multiple modalities to draw complex inferences about the structure of the environment and agents' behavior within it (Agrawal & Schachner, 2023;Gerstenberg et al, 2021;Schachner & Kim, 2018;Siegel et al, 2021). However, young children struggle with abstract multimodal inferences (Agrawal & Schachner, 2023;Gori et al, 2008;Outa et al, 2022) and models of adults have been limited to reasoning about physical events (e.g., Gerstenberg et al, 2021). Causal event reconstruction with multimodal evidence in situations involving agents has yet to be studied.…”

Section: Evidencementioning

confidence: 99%

See 1 more Smart Citation

Whodunnit? Inferring what happened from multimodal evidence

Wu,

Brockbank,

Cha

et al. 2024

Preprint

View full text Add to dashboard Cite

Humans are remarkably adept at inferring the causes of events in their environment; doing so often requires incorporating information from multiple sensory modalities. For instance, if a car slows down in front of us, inferences about why they did so are rapidly revised if we also hear sirens in the distance. Here, we investigate the ability to reconstruct others' actions and events from the past by integrating multimodal information. Participants were asked to infer which of two agents performed an action in a household setting given either visual evidence, auditory evidence, or both. We develop a computational model that makes inferences by generating multimodal simulations, and also evaluate our task on a large language model (GPT-4) and a large multimodal model (GPT-4V). We find that humans are relatively accurate overall and perform best when given multimodal evidence. GPT-4 and GPT-4V performance comes close overall, but is very weakly correlated with participants across individual trials. Meanwhile, the simulation model captures the pattern of human responses well. Multimodal event reconstruction represents a challenge for current AI systems, and frameworks that draw on the cognitive processes underlying people's ability to reconstruct events offer a promising avenue forward.

show abstract

Section: Evidencementioning

confidence: 99%

Section: Evidencementioning

confidence: 99%

Whodunnit? Inferring what happened from multimodal evidence

Wu,

Brockbank,

Cha

et al. 2024

Preprint

View full text Add to dashboard Cite

show abstract

“…Following this line of thought, one might consider whether making sounds of drinks being poured extra-cold might make them appear more refreshing, and hence more thirst-quenching (see also [ 86 ]). The research shows how sounds can be made to sound colder than cold—extra-chilled, in other words [ 92 , 93 , 94 ]. A drink that is seen being poured in an advert can be made to sound cooler, and hence presumably more thirst-quenching, simply by caricaturing actual pouring sounds to make a drink sound colder than cold (e.g., see ‘The sound of temperature’ for sonic examples: [ 95 ]).…”

Section: Temperature and Refreshmentmentioning

confidence: 99%

Encouraging (Nudging) People to Increase Their Fluid Intake

Spence

2023

Nutrients

View full text Add to dashboard Cite

This narrative historical review considers the various routes to nudging consumers towards drinking more, given self-reported evidence that many people are often not adequately hydrated. This review builds on the related notion of ‘visual hunger’. Interestingly, however, while many desirable foods are associated with distinctive sensory qualities (such as an appetizing smell), that may capture the consumer’s (visual) attention, it is less clear that there is an equivalent sensory attentional capture by hydration-related cues. One of the other important differences between satiety and thirst is that people tend to overconsume if they use interoceptive satiety cues to decide when to stop eating, while the evidence suggests that people typically stop drinking prior to being adequately hydrated. What is more, the increasing amount of time we spend in consistently warm indoor environments may also be exacerbating our need to drink more. A number of concrete suggestions are made concerning how people may be encouraged (or nudged) to imbibe sufficient water.

show abstract

“…Children may perceptually learn the cross-modal correspondences (Chow et al, 2016;Nava et al, 2016). Starting from 7 years of age, children can accurately discriminate cold from hot water based on nothing more than sonic cues, while younger children do not show this ability (Agrawal & Schachner, 2022). Furthermore, auditory cues also allow for the differentiation of drinks having differing levels of carbonation.…”

Section: Introductionmentioning

confidence: 99%