Animals in Virtual Environments

Naik, Hemal; Bastien, Renaud; Navab, Nassir; Couzin, Iain D.

doi:10.1109/tvcg.2020.2973063

Cited by 38 publications

(37 citation statements)

References 89 publications

(261 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Because of this, multimodal virtual reality (VR) systems have attracted a great deal of attention (Kaushik et al, 2020) (Naik et al, 2020). The advantage of using a multimodal VR system is that not only can behavior be measured at a large spatiotemporal scale, but the transmission of stimuli can be precisely controlled and the behavioral output can be precisely measured.…”

Section: Virtual Reality For Insect Behavior Measurementsmentioning

confidence: 99%

Analysis of Multisensory-Motor Integration in Olfactory Navigation of Silkmoth, Bombyx mori, using Virtual Reality System

Yamada

Ohashi

Hosoda

et al. 2021

Preprint

View full text Add to dashboard Cite

Most animals survive and thrive due to navigation behavior to reach their destinations. In order to navigate, it is important for animals to integrate information obtained from multisensory inputs and use that information to modulate their behavior. In this study, by using a virtual reality (VR) system for an insect, we investigated how an adult silkmoth integrates visual and wind direction information during female search behavior (olfactory behavior). According to the behavioral experiments using the VR system, the silkmoth had the highest navigation success rate when odor, vision, and wind information were correctly provided. However, we found that the success rate of the search signifcantly reduced if wind direction information was provided that was incorrect from the direction actually detected. This indicates that it is important to acquire not only odor information, but also wind direction information correctly. In other words, Behavior was modulated by the degree of co-incidence between the direction of arrival of the odor and the direction of arrival of the wind, and posture control (angular velocity control) was modulated by visual information. We mathematically modeled the modulation of behavior using multisensory information and evaluated it by simulation. As a result, the mathematical model not only succeeded in reproducing the actual female search behavior of the silkmoth, but can also improve search success relative to the conventional odor source search algorithm.

show abstract

Section: Virtual Reality For Insect Behavior Measurementsmentioning

confidence: 99%

Analysis of Multisensory-Motor Integration in Olfactory Navigation of Silkmoth, Bombyx mori, using Virtual Reality System

Yamada

Ohashi

Hosoda

et al. 2021

Preprint

View full text Add to dashboard Cite

show abstract

“…The current state of the art: immersive virtual reality (VR) and low-latency playback experiment-with fully animated, photo-realistic, 3D models, provide a rich experimental basis for investigating the relationship between visual inputs, neural activity, and behavior. [87][88][89][90] VR systems are also beginning to better account for species-specific sensory biases including photoreceptor sensitivity, flicker fusion rate, acuity, and depth perception. 89,91 Still, currently these approaches rely on human-in-the-loop interventions for creating stimulus with even moderate complexity.…”

Section: Declaration Of Interestsmentioning

confidence: 99%

“…[87][88][89][90] VR systems are also beginning to better account for species-specific sensory biases including photoreceptor sensitivity, flicker fusion rate, acuity, and depth perception. 89,91 Still, currently these approaches rely on human-in-the-loop interventions for creating stimulus with even moderate complexity.…”

Section: Declaration Of Interestsmentioning

confidence: 99%

Decontextualized learning for interpretable hierarchical representations of visual patterns

Etheredge

Schartl

Jordan

2020

Preprint

View full text Add to dashboard Cite

Apart from discriminative models for classification and object detection tasks, the application of deep convolutional neural networks to basic research utilizing natural imaging data has been somewhat limited; particularly in cases where a set of interpretable features for downstream analysis is needed, a key requirement for many scientific investigations. We present an algorithm and training paradigm designed specifically to address this: decontextualized hierarchical representation learning (DHRL). By combining a generative model chaining procedure with a ladder network architecture and latent space regularization for inference, DHRL address the limitations of small datasets and encourages a disentangled set of hierarchically organized features. In addition to providing a tractable path for analyzing complex hierarchal patterns using variation inference, this approach is generative and can be directly combined with empirical and theoretical approaches. To highlight the extensibility and usefulness of DHRL, we demonstrate this method in application to a question from evolutionary biology.

show abstract

“…The use of virtual stimuli has become common in studies of both human psychology and animal cognition [1][2][3][4][5][6][7]. Subjects are sometimes required to respond to virtual stimuli through real-life choices, for example by selecting between real-life objects and agents after observing relevant videos on a screen [8,9].…”

Section: Introductionmentioning

confidence: 99%

Are parrots naive realists? Kea behave as if the real and virtual worlds are continuous

2021

View full text Add to dashboard Cite

Human psychology and animal cognition have increasingly used virtual stimuli to test cognitive abilities, with the expectation that participants are ‘naive realists’, that is, that they perceive virtual environments as both equivalent and continuous with real-life equivalents. However, there have been no attempts to investigate whether nonhuman subjects in fact behave as if physical processes in the virtual and real worlds are continuous. As kea parrots have previously shown the ability to transfer knowledge between real stimuli and both images on paper and images on touchscreens, here we test whether kea behave as naive realists and so expect physical processes to be continuous between the physical and virtual worlds. We find that, unlike infants, kea do not discriminate between these two contexts, and that they do not exhibit a preference for either. Our findings therefore validate the use of virtual stimuli as a powerful tool for testing the cognition of nonhuman animal species.

show abstract

Animals in Virtual Environments

Cited by 38 publications

References 89 publications

Analysis of Multisensory-Motor Integration in Olfactory Navigation of Silkmoth, Bombyx mori, using Virtual Reality System

Analysis of Multisensory-Motor Integration in Olfactory Navigation of Silkmoth, Bombyx mori, using Virtual Reality System

Decontextualized learning for interpretable hierarchical representations of visual patterns

Are parrots naive realists? Kea behave as if the real and virtual worlds are continuous

Contact Info

Product

Resources

About