“…Other qualitative feedback responses were obtained by focus groups or workshops (n=5) [43,57,61,67,68]. The alert firing rate (n=12) [43,55,62,[69][70][71][72][73][74][75][76][77] and alert acceptance rate (n=15) [27,29,43,58,61,62,69,74,[78][79][80][81][82][83][84] were also common metrics used to understand alarm fatigue and acceptability. Although metrics of relevance such as sensitivity, specificity, and positive predictive value (PPV) were referenced several times [77,[84][85][86][87][88], only one study evaluated these metrics as pre-specified outcomes [49].…”