Color Shadows 2: Assessing the Impact of XAI on Diagnostic Decision-Making

Natali, Chiara; Famiglini, Lorenzo; Campagner, Andrea; La Maida, Giovanni Andrea; Gallazzi, Enrico; Cabitza, Federico

doi:10.1007/978-3-031-44064-9_33

Cited by 3 publications

References 24 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

Invisible to Machines: Designing AI that Supports Vision Work in Radiology

Anichini,

Natali,

Cabitza

2024

Comput Supported Coop Work

Self Cite

View full text Add to dashboard Cite

In this article we provide an analysis focusing on clinical use of two deep learning-based automatic detection tools in the field of radiology. The value of these technologies conceived to assist the physicians in the reading of imaging data (like X-rays) is generally assessed by the human-machine performance comparison, which does not take into account the complexity of the interpretation process of radiologists in its social, tacit and emotional dimensions. In this radiological vision work, data which informs the physician about the context surrounding a visible anomaly are essential to the definition of its pathological nature. Likewise, experiential data resulting from the contextual tacit knowledge that regulates professional conduct allows for the assessment of an anomaly according to the radiologist’s, and patient’s, experience. These data, which remain excluded from artificial intelligence processing, question the gap between the norms incorporated by the machine and those leveraged in the daily work of radiologists. The possibility that automated detection may modify the incorporation or the exercise of tacit knowledge raises questions about the impact of AI technologies on medical work. This article aims to highlight how the standards that emerge from the observation practices of radiologists challenge the automation of their vision work, but also under what conditions AI technologies are considered “objective” and trustworthy by professionals.

show abstract