Exploration mode affects visuohaptic integration of surface orientation

Plaisier, Myrthe A.; Dam, Loes van; Glowania, Catharina; Ernst, Marc O.

doi:10.1167/14.13.22

Cited by 14 publications

(16 citation statements)

References 29 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…This would have likely resulted in increased weighting of the visual cue, which was inconsistent with our data. On the other hand, a recent study suggests that differences in the time course of the acquisition of sensory information can affect whether cues are even integrated (Plaisier et al 2014). In forming a percept of surface orientation, visual and haptic cues were only combined when the exploration mode (parallel vs. serial) was the same.…”

Section: Discussionmentioning

confidence: 99%

Trust in haptic assistance: weighting visual and haptic cues based on error history

2017

View full text Add to dashboard Cite

To effectively interpret and interact with the world, humans weight redundant estimates from different sensory cues to form one coherent, integrated estimate. Recent advancements in physical assistance systems, where guiding forces are computed by an intelligent agent, enable the presentation of augmented cues. It is unknown, however, if cue weighting can be extended to augmented cues. Previous research has shown that cue weighting is determined by the reliability (inversely related to uncertainty) of cues within a trial, yet augmented cues may also be affected by errors that vary over trials. In this study, we investigate whether people can learn to appropriately weight a haptic cue from an intelligent assistance system based on its error history. Subjects held a haptic device and reached to a hidden target using a visual (Gaussian distributed dots) and haptic (force channel) cue. The error of the augmented haptic cue varied from trial to trial based on a Gaussian distribution. Subjects learned to estimate the target location by weighting the visual and augmented haptic cues based on their perceptual uncertainty and experienced errors. With both cues available, subjects were able to find the target with an improved or equal performance compared to what was possible with one cue alone. Our results show that the brain can learn to reweight augmented cues from intelligent agents, akin to previous observations of the reweighting of naturally occurring cues. In addition, these results suggest that the weighting of a cue is not only affected by its within-trial reliability but also the history of errors.

show abstract

Section: Discussionmentioning

confidence: 99%

Trust in haptic assistance: weighting visual and haptic cues based on error history

2017

View full text Add to dashboard Cite

show abstract

“…However, a common high-level perceptual representation does not necessarily mean that the information from different sources also share common low-level sensory neural populations. For instance, it has been shown that whether or not simultaneous information from vision and touch is combined into a unified percept does depend on the exploration modes used 35 . Furthermore, the current study shows that the perceptual representation of our environment, and in particular local shape information, can be highly unstable when different exploration modes are used in an intermixed fashion ( Fig.…”

Section: Discussionmentioning

confidence: 99%

Haptic adaptation to slant: No transfer between exploration modes

Dam

Plaisier

Glowania

et al. 2016

Sci Rep

View full text Add to dashboard Cite

Human touch is an inherently active sense: to estimate an object’s shape humans often move their hand across its surface. This way the object is sampled both in a serial (sampling different parts of the object across time) and parallel fashion (sampling using different parts of the hand simultaneously). Both the serial (moving a single finger) and parallel (static contact with the entire hand) exploration modes provide reliable and similar global shape information, suggesting the possibility that this information is shared early in the sensory cortex. In contrast, we here show the opposite. Using an adaptation-and-transfer paradigm, a change in haptic perception was induced by slant-adaptation using either the serial or parallel exploration mode. A unified shape-based coding would predict that this would equally affect perception using other exploration modes. However, we found that adaptation-induced perceptual changes did not transfer between exploration modes. Instead, serial and parallel exploration components adapted simultaneously, but to different kinaesthetic aspects of exploration behaviour rather than object-shape per se. These results indicate that a potential combination of information from different exploration modes can only occur at down-stream cortical processing stages, at which adaptation is no longer effective.

show abstract

“…However, observers may have little experience with single-finger slant estimation, because multiple fingers or the whole hand might ordinarily be used for such a task (Rosas et al 2005). Alternatively, cue combination may be suboptimal when one cue provides all information in parallel but the other cue provides information serially (Plaisier et al 2014). Reliability estimation might also be difficult when the reliability is very low.…”

Section: Review Of Suboptimality In Perceptual Decision Makingmentioning

confidence: 99%

Suboptimality in perceptual decision making

2018

View full text Add to dashboard Cite

Human perceptual decisions are often described as optimal. Critics of this view have argued that claims of optimality are overly flexible and lack explanatory power. Meanwhile, advocates for optimality have countered that such criticisms single out a few selected papers. To elucidate the issue of optimality in perceptual decision making, we review the extensive literature on suboptimal performance in perceptual tasks. We discuss eight different classes of suboptimal perceptual decisions, including improper placement, maintenance, and adjustment of perceptual criteria, inadequate tradeoff between speed and accuracy, inappropriate confidence ratings, misweightings in cue combination, and findings related to various perceptual illusions and biases. In addition, we discuss conceptual shortcomings of a focus on optimality, such as definitional difficulties and the limited value of optimality claims in and of themselves. We therefore advocate that the field drop its emphasis on whether observed behavior is optimal and instead concentrate on building and testing detailed observer models that explain behavior across a wide range of tasks. To facilitate this transition, we compile the proposed hypotheses regarding the origins of suboptimal perceptual decisions reviewed here. We argue that verifying, rejecting, and expanding these explanations for suboptimal behavior - rather than assessing optimality per se - should be among the major goals of the science of perceptual decision making.

show abstract

Exploration mode affects visuohaptic integration of surface orientation

Cited by 14 publications

References 29 publications

Trust in haptic assistance: weighting visual and haptic cues based on error history

Trust in haptic assistance: weighting visual and haptic cues based on error history

Haptic adaptation to slant: No transfer between exploration modes

Suboptimality in perceptual decision making

Contact Info

Product

Resources

About