Can minimal clinically important differences in patient reported outcome measures be predicted by machine learning in patients with total knee or hip arthroplasty? A systematic review

Abstract

Objectives To systematically review studies using machine learning (ML) algorithms to predict whether patients undergoing total knee or total hip arthroplasty achieve an improvement as high or higher than the minimal clinically important differences (MCID) in patient reported outcome measures (PROMs) (classification problem). Methods Studies were eligible to be included in the review if they collected PROMs both pre- and postintervention, reported the method of MCID calculation and applied ML. ML was defined as a family of models which automatically learn from data when selecting features, identifying nonlinear relations or interactions. Predictive performance must have been assessed using common metrics. Studies were searched on MEDLINE, PubMed Central, Web of Science Core Collection, Google Scholar and Cochrane Library. Study selection and risk of bias assessment (ROB) was conducted by two independent researchers. Results 517 studies were eligible for title and abstract screening. After screening title and abstract, 18 studies qualified for full-text screening. Finally, six studies were included. The most commonly applied ML algorithms were random forest and gradient boosting. Overall, eleven different ML algorithms have been applied in all papers. All studies reported at least fair predictive performance, with two reporting excellent performance. Sample size varied widely across studies, with 587 to 34,110 individuals observed. PROMs also varied widely across studies, with sixteen applied to TKA and six applied to THA. There was no single PROM utilized commonly in all studies. All studies calculated MCIDs for PROMs based on anchor-based or distribution-based methods or referred to literature which did so. Five studies reported variable importance for their models. Two studies were at high risk of bias. Discussion No ML model was identified to perform best at the problem stated, nor can any PROM said to be best predictable. Reporting standards must be improved to reduce risk of bias and improve comparability to other studies.

Machine learning as a tool to identify inpatients who are not at risk of adverse drug events in a large dataset of a tertiary care hospital in the USA

“…Furthermore, as recommended, 27,68 model calibration was reported 69 . In contrast to discrimination, calibration measures the numerical distance between a forecasted probability by the algorithm and the true outcome 70 .…”

“…ML methods are, in contrast to traditional regression methods, able to detect nonlinearities, variable interactions and/or variable selection on their own 26 . However, it is recommended to include regression methods such as logistic regression (LR) as baseline comparison method when applying ML methods 26,27 . A recent application exploiting ML was able to demonstrate good performance in a sample of Chinese paediatrics inpatients 28 .…”

“…26 However, it is recommended to include regression methods such as logistic regression (LR) as baseline comparison method when applying ML methods. 26,27 A recent application exploiting ML was able to demonstrate good performance in a sample of Chinese paediatrics inpatients. 28 However, an application of ML to a broader sample of inpatients of all ages and multiple ethnical backgrounds has not yet been performed.…”

Predicting whether patients will achieve minimal clinically important differences following hip or knee arthroplasty

“…Machine learning (ML), a sub-branch of artificial intelligence, 35,36 is a promising approach in predicting whether patients achieve MCIDs following HA/KA. 24,26,[37][38][39][40][41] In classification tasks, supervised ML can be applied. 36,42,43 ML differs from classical statistical analysis as it can detect non-linearities, interactions, or variable selection itself.…”

Advancements in Artificial Intelligence for Foot and Ankle Surgery: A Systematic Review

“…Artificial intelligence (AI) and its subsets machine learning (ML) and deep learning (DL) are being increasingly explored for applications in medicine and orthopaedic surgery. 3 , 7 , 8 , 10 , 12 , 15 , 19 , 25 , 29 , 31 , 49 The essentials of AI, ML, and DL for orthopaedic surgeons, clinicians, and researchers have been thoroughly described in previous literature. 6 , 12 , 34 , 37 , 38 , 45 Briefly, AI and its subsets involves the use of technology to simulate human intelligence.…”