The Effect of Incorrect Reliability Information on Expectations, Perceptions, and Use of Automation

Barg-Walkow, Laura H.; Rogers, Wendy A.

doi:10.1177/0018720815610271

Cited by 35 publications

(20 citation statements)

References 51 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Such group awareness in a virtual setting is also seen in many other large-scale online environments, such as Wikipedia and Stack Overflow, where people help each other as virtual groups with no seeming reward Faraj, 2000, 2005;Forte et al, 2009). Our findings suggest the possibility of enhancing group output through design interventions that address individual behavioral plasticity to ultimately modulate spontaneous adaption of collective dynamics (Feigh et al, 2012;Barg-Walkow and Rogers, 2016). For example, by exposing workers to social information about a distribution of other workers, the collective task designer or administrator could dynamically influence workers' task choice in a desired direction.…”

Section: Discussionsupporting

confidence: 60%

The Influence of Social Information and Self-expertise on Emergent Task Allocation in Virtual Groups

et al. 2018

View full text Add to dashboard Cite

Dynamic group coordination facilitates adaptive division of labor in response to group-level changes. Yet, little is known about how it can be operationalized in online collaborations among individuals with limited information about each other. We hypothesized that simple social information about the task distribution of others can elicit emergent task allocation. We conducted an online experiment where participants analyze images of a polluted canal by freely switching between two tasks: creating keyword-based tags for images and categorizing existing tags. During the task execution, we presented experimentally manipulated information about the contrasting group-level task distributions. Participants did not change the effort allocation between the tasks when they were notified that the group is deficient in workers in the task they intrinsically prefer. By contrast, they allocated more effort to the less preferred task than they would intrinsically do when their intrinsic effort allocation counterbalances the current distribution of workers in the group. Such behavioral changes were observed more strongly among those with higher skills in the less preferred task. Our results demonstrate the possibility of optimizing group coordination through design interventions at the individual level that lead to spontaneous adaption of division of labor at the group level. When participants were provided information about the group-level task distribution, they tend to allocate more effort to the task against their intrinsic preference.

show abstract

Section: Discussionsupporting

confidence: 60%

The Influence of Social Information and Self-expertise on Emergent Task Allocation in Virtual Groups

et al. 2018

View full text Add to dashboard Cite

show abstract

“…The current results suggest that such a display might be especially helpful to older adults by alleviating the working memory demands of recovering from a failure of the automation (environmental support; Morrow & Rogers, 2008). Promising research suggests that providing younger adults with reliability information that is artificially higher than normal might actually properly calibrate beliefs and expectations about automation (Barg-Walkow & Rogers, 2015). Such a strategy may also work with older adults because it may take advantage of their somewhat increased tendency to trust automation but takes into account their tendency to estimate reliability downward (Sanchez, Fisk, & Rogers, 2004).…”

Section: Resultsmentioning

confidence: 78%

The effect of individual differences in working memory in older adults on performance with different degrees of automated technology

et al. 2016

View full text Add to dashboard Cite

A leading hypothesis to explain older adults' overdependence on automation is age-related declines in working memory. However, it has not been empirically examined. The purpose of the current experiment was to examine how working memory affected performance with different degrees of automation in older adults. In contrast to the well-supported idea that higher degrees of automation, when the automation is correct, benefits performance but higher degrees of automation, when the automation fails, increasingly harms performance, older adults benefited from higher degrees of automation when the automation was correct but were not differentially harmed by automation failures. Surprisingly, working memory did not interact with degree of automation but did interact with automation correctness or failure. When automation was correct, older adults with higher working memory ability had better performance than those with lower abilities. But when automation was incorrect, all older adults, regardless of working memory ability, performed poorly. Practitioner Summary: The design of automation intended for older adults should focus on ways of making the correctness of the automation apparent to the older user and suggest ways of helping them recover when it is malfunctioning.

show abstract

“…In such situations, instructions and training with automation form an operator's expectations, prior knowledge and understanding (Hoff & Bashir, 2015). How an automation is presented to an operator constitutes his expectations of the automated system's reliability (Barg-Walkow & Rogers, 2016;Mayer, Rogers, & Fisk, 2009) and the expectations, in turn, constitute the perception of an automation's reliability (Madhavan & Wiegmann, 2005;Pop et al, 2015). Accordingly, Beggiato and Krems (2013) found a negative relationship between the number of potentially critical situations that are presented in preliminary information, and initial trust in and acceptance of an ACC system.…”

Section: Prior Information Influences Trustmentioning

confidence: 99%

Introduction matters: Manipulating trust in automation and reliance in automated driving

2018

View full text Add to dashboard Cite

Trust in automation is a key determinant for the adoption of automated systems and their appropriate use. Therefore, it constitutes an essential research area for the introduction of automated vehicles to road traffic. In this study, we investigated the influence of trust promoting (Trust promoted group) and trust lowering (Trust lowered group) introductory information on reported trust, reliance behavior and takeover performance. Forty participants encountered three situations in a 17-minute highway drive in a conditionally automated vehicle (SAE Level 3). Situation 1 and Situation 3 were non-critical situations where a take-over was optional. Situation 2 represented a critical situation where a take-over was necessary to avoid a collision. A non-driving-related task (NDRT) was presented between the situations to record the allocation of visual attention. Participants reporting a higher trust level spent less time looking at the road or instrument cluster and more time looking at the NDRT. The manipulation of introductory information resulted in medium differences in reported trust and influenced participants' reliance behavior. Participants of the Trust promoted group looked less at the road or instrument cluster and more at the NDRT. The odds of participants of the Trust promoted group to overrule the automated driving system in the non-critical situations were 3.65 times (Situation 1) to 5 times (Situation 3) higher. In Situation 2, the Trust promoted group's mean take-over time was extended by 1154 ms and the mean minimum time-to-collision was 933 ms shorter. Six participants from the Trust promoted group compared to no participant of the Trust lowered group collided with the obstacle. The results demonstrate that the individual trust level influences how much drivers monitor the environment while performing an NDRT. Introductory information influences this trust level, reliance on an automated driving system, and if a critical take-over situation can be successfully solved.

show abstract

The Effect of Incorrect Reliability Information on Expectations, Perceptions, and Use of Automation

Abstract: Introductions should be designed according to desired outcomes for expectations, perceptions, and use of the automation. Low expectations have long-lasting effects.

Cited by 35 publications

References 51 publications

The Influence of Social Information and Self-expertise on Emergent Task Allocation in Virtual Groups

The Influence of Social Information and Self-expertise on Emergent Task Allocation in Virtual Groups

The effect of individual differences in working memory in older adults on performance with different degrees of automated technology

Introduction matters: Manipulating trust in automation and reliance in automated driving

Contact Info

Product

Resources

About