Automation Failures on Tasks Easily Performed by Operators Undermine Trust in Automated Aids

Madhavan, Poornima; Wiegmann, Douglas A.; Lacson, Frank C.

doi:10.1518/001872006777724408

Cited by 214 publications

(169 citation statements)

References 28 publications

Supporting

Mentioning

162

Contrasting

Unclassified

Order By: Relevance

“…2]. In those cases, people were found to rely on self, rather than on the aid, as the detection of automation failure boosts one's self confidence [16].…”

Section: Summary and Interpretation Of The Resultsmentioning

confidence: 99%

“…uncritically rely on its correct functioning [11]. Disuse has been shown to occur in interaction with new technologies, in light of obvious errors of the automated aid, especially when the risks are high, or when an automation error happens during easy tasks [15][16][17]. In addition, when led to believe that their aid is near perfect, e.g.…”

Section: Inappropriate Automation Usementioning

confidence: 99%

“…Evidence of automation bias had been found in various domains, e.g. in aviation [21,22], luggage screening [16], process control [23], military [24], command and control [25], and health care [26].…”

Section: Inappropriate Automation Usementioning

confidence: 99%

“…Moreover, providing inspectors with information about why the automated system might err may lead to a more appropriate trust and selection of better discriminating strategies-by allowing them to better discriminate between reliability of the aid and their own reliability [16,24,27]. In addition, the knowledge about how the automation works leads to a more appropriate automation use [11].…”

Section: Implications Of the Study For The Ndt Practicementioning

confidence: 99%

See 3 more Smart Citations

A human factors perspective on the use of automated aids in the evaluation of NDT data

Bertovic

2016

AIP Conference Proceedings

View full text Add to dashboard Cite

Abstract. In comparison to manual NDT methods, mechanized NDT is considered to be more reliable for a number of reasons, one of which being that the role of the inspectors and, therewith, the potential for human error, have been reduced. However, human-automation interaction research suggests that in spite of its numerous benefits, automation can lead to new yet unknown risks. One of those risks is inappropriate reliance on automation, which can result in automation misuse and disuse. The aim of this study was to investigate the potential inappropriate use of automation (specificallythe automated aids) in NDT addressing therewith the prevalent belief in the high reliability of automation held by the NDT community. To address this issue, 70 NDT trainees were asked to control the results of an eddy current data evaluation, allegedly provided by an automated aid, i.e. indication detection and sizing software. Seven errors were implemented into the task and it was measured to what extent the participants agreed with the aid. The results revealed signs of both misuse (agreeing with the aid even though it is incorrect) and disuse (disagreeing with the aid even though it is correct) of the aid that can affect the reliability with which inspections are carried out. Whereas misuse could be explained by a lower propensity to take risks and by a decreased verification behavior-possibly due to bias towards automation and complacent behavior-, disuse was assigned to problems in establishing the sizing criterion or to general difficulties in sizing. The implications of these results for the NDT praxis including suggestions for the decrease of automation bias are discussed.

show abstract

“…2]. In those cases, people were found to rely on self, rather than on the aid, as the detection of automation failure boosts one's self confidence [16].…”

Section: Summary and Interpretation Of The Resultsmentioning

confidence: 99%

Section: Inappropriate Automation Usementioning

confidence: 99%

Section: Inappropriate Automation Usementioning

confidence: 99%

Section: Implications Of the Study For The Ndt Practicementioning

confidence: 99%

See 2 more Smart Citations

A human factors perspective on the use of automated aids in the evaluation of NDT data

Bertovic

2016

AIP Conference Proceedings

View full text Add to dashboard Cite

show abstract

“…According to Dzindolet et al, effort investment is based on the outcome of a cost-benefit analysis in which operator states such as fatigue and workload, operators' intrinsic interests in the task, as well as penalties and rewards associated with performance consequences, are taken into account. The difficulty of the task itself also has an impact on operators' effort in the way that operators are more prone to rely on a system if they perceive that task demands exceed their capabilities (e.g., Madhavan, Wiegmann, & Lacson, 2006). Recently, Lee and See (2004) proposed a dynamic model of trust and reliance on automation.…”

Section: Theoretical Approaches To Reliance On Automationmentioning

confidence: 99%

Drivers’ Reliance on Lane-Keeping Assistance Systems as a Function of the Level of Assistance

Popken

Krems

2015

Z. Arb. Wiss.

View full text Add to dashboard Cite

The 3 C's of anthropomorphism: Connection, comprehension, and competition

Yang

Aggarwal

McGill

2019

Consumer Psychology Review

View full text Add to dashboard Cite

Anthropomorphism, or imbuing nonhuman entities with human traits, is widely prevalent in the marketplace. The last decade of consumer research demonstrates that when imbued with human characteristics, anthropomorphized brands and products become active participants in the consumption experience and are viewed and treated fundamentally differently than those viewed simply as objects. We identify three dimensions around how consumers relate to anthropomorphized entities: connection, comprehension, and competition. The first two C's highlight how anthropomorphized brands and products benefit consumers by fulfilling belongingness needs (connection) and helping consumers understand unfamiliar situations and products (comprehension). In contrast, the competition dimension highlights how anthropomorphized brands and products are perceived as adversaries or potential threats to consumers’ individual goals. By identifying competition as the third C, we illuminate self‐protection as an additional motivation that shapes consumers’ responses to anthropomorphized entities—a motivation that has not been directly accounted for in previous theorizing.

show abstract

Automation Failures on Tasks Easily Performed by Operators Undermine Trust in Automated Aids

Abstract: Potential applications include the implementation of system design solutions that circumvent the negative effects of easy automation errors.

Cited by 214 publications

References 28 publications

A human factors perspective on the use of automated aids in the evaluation of NDT data

A human factors perspective on the use of automated aids in the evaluation of NDT data

Drivers’ Reliance on Lane-Keeping Assistance Systems as a Function of the Level of Assistance

The 3 C's of anthropomorphism: Connection, comprehension, and competition

Contact Info

Product

Resources

About