Evaluating practice-centered awareness in cross-boundary telehealth decision support systems

Designing for practice-based context-awareness in ubiquitous e-health environments

“…In this section, we present an experimental study to evaluate the performance of CaDHealth by determining how much significant utility the system provides to an end user clinician. A more elaborate evaluation of the system is presented in [25]. Recent studies in context-aware applications for decision support particularly in complex, dynamic, and ubiquitous environments, have emphasized the need to take system evaluation beyond typical usability testing.…”

“…Sampling was purposive and sought clinicians interested in research and cross-boundary clinical decision support who might critically appraise the tool and provide recommendations for its future enhancement. Participants were asked to monitor a simulation of a work practice display [25] for 94 simulation runs (47 for each participant). The simulation consists of animated screenshots of the CaDHealth prototype inter-connected to portray clinical decision making scenarios created jointly with the participants.…”

“…The simulation consists of animated screenshots of the CaDHealth prototype inter-connected to portray clinical decision making scenarios created jointly with the participants. SAGAT uses expert knowledge to develop questions and probes that assess a participant's awareness of a work situation [25]. It involves freezing the simulation at randomly selected intervals during which participants are probed as to their perceptions of the user work situation at that time.…”

“…workarounds and work processes that have deviated outside of the defined threshold boundary) goes above the process value threshold, indicating that some practices have a positive value and occur as a result of optimizing the multi-objective of care delivery within a given situation. As shown in Figure 8, divergence of work processes occurs mostly towards the end of the process; in [25], we investigated the effectiveness of the CaDHealth approach in raising awareness about medical practice and evaluated its impact on clinical decision-making processes.…”

A Decision Support System of Quality Forecast Evaluation for Complex Products Based on Data Warehouse

“…Moreover, knowledge of quality managers and frequent communications with customers both formally and informally is often cited as being extremely important when forecasting product quality and implementing tactics to improve quality. It is able to determine the development trend of quality management and to match these contours with the models stored in the object databases of the DSS [8]. The system is able to perform data collection, quality decision and evaluation simultaneously in real-time applications.…”