Potential Biases in Machine Learning Algorithms Using Electronic Health Record Data

Abstract

A promise of machine learning in health care is the avoidance of biases in diagnosis and treatment; a computer algorithm could objectively synthesize and interpret the data in the medical record. Integration of machine learning with clinical decision support tools, such as computerized alerts or diagnostic support, may offer physicians and others who provide health care targeted and timely information that can improve clinical decisions. Machine learning algorithms, however, may also be subject to biases. The biases include those related to missing data and patients not identified by algorithms, sample size and underestimation, and misclassification and measurement error. There is concern that biases and deficiencies in the data used by machine learning algorithms may contribute to socioeconomic disparities in health care. This Special Communication outlines the potential biases that may be introduced into machine learning–based clinical decision support tools that use electronic health record data and proposes potential solutions to the problems of overreliance on automation, algorithms based on biased data, and algorithms that do not provide information that is clinically meaningful. Existing health care disparities should not be amplified by thoughtless or excessive reliance on machines.

A Path for Translation of Machine Learning Products into Healthcare Delivery

“…There are additional ethical challenges in machine learning that are described in more detail in related reviews. 107,109 Teams building machine learning products need to consider these challenges early and often and incorporate ethical and legal perspectives into their work.…”

NCSBN’s Environmental Scan A Portrait of Nursing and Healthcare in 2020 and Beyond

“…However, as attention turns to use of machine learning algorithms in healthcare, organizations must be aware that machine learning applied to clinical decision support systems can also be subject to important societal biases, and if used incorrectly, can amplify healthcare disparities (Gianfrancesco, Tamang, Tazdany, & Schmajuk, 2018). This was true in a widely reported case in 2019 when a machine learning algorithm used by many insurers incorporated a faulty metric to determine which patients were high-risk and qualified for additional care management (Obermeier, Powers, Vogeli, & Mullainathan, 2019).…”

Approximate and Situated Causality in Deep Learning

“…Finally, a completely different type of problem, but also important, is how to reduce the biased datasets or heuristics we provide to our DL systems [46] as well as how to control the biases that make us not able to interpret DL results properly [47]. Obviously, if there is any malicious value related to such bias, it must be also controlled.…”