A personalized and data-driven training approach was highly regarded by providers. EMR usage reports provided extensive data to identify and prioritize training content and were valuable to measure the impact of training on provider time in system. With the growth of EMR implementation and the reported relationship of EMR use to burnout, continuous and personalized training after EMR implementation is effective to reduce the time in system and increase confidence.

User-centered design should focus on workflow functionality, terminology, and user interface issues for mHealth applications. These themes illustrated issues aligned with four of Nielsen's Usability Heuristics: match between system and the real world, consistency and standards, flexibility and efficiency of use, and aesthetic and minimalist design. We identified workflow and terminology issues that may be specific to the use of an mHealth application focused on safety and used by hospitalized patients and their families.

IMPORTANCE Measurement of the quality of care is important for alternative payment models in oncology, yet the ability to distinguish high-quality from low-quality care across oncology practices remains uncertain. OBJECTIVE To assess the reliability of cancer care quality measures across oncology practices using registry and claims-based measures of process, utilization, end-of-life (EOL) care, and survival, and to assess the correlations of practice-level performance across measure and cancer types. DESIGN, SETTING, AND PARTICIPANTS This cross-sectional study used the Surveillance, Epidemiology, and End Results (SEER) Program registry linked to Medicare administrative data to identify individuals with lung cancer, breast cancer, or colorectal cancer (CRC) that was newly

Objective As part of ongoing implementation of electronic patient-reported outcome tools at the Dana-Farber Cancer Institute, here we describe the development of the electronic New Patient Intake Questionnaire. Materials and Methods The original New Patient Intake Questionnaire includes a review of symptoms, oncology history, family history, health behaviors, health and social status, health literacy and numeracy, which was modified for integration into the EHR using content determination, build and configuration, implementation, analytics, and interventions. The engagement of key stakeholders, including patients, clinical staff, and providers, throughout the development and deployment of the electronic Questionnaire was crucial to producing a successful tool. Continual modifications based on input of stakeholders (such as mode of tool deployment) were made to ensure the utility and usability of the tool for both patients and providers. Results Implementation of the EHR-integrated electronic New Patient Intake Questionnaire improved collection of the PRD by increasing questionnaire accessibility for patients, while also providing all available data to clinicians and researchers. Careful consideration of the content and configuration of the questionnaire allowed for a successful, institute-wide implementation of the tool. Discussion This effort demonstrates the feasibility of implementation of a system-wide electronic questionnaire, emphasizing the importance of iterative refinement to create a tool that is both patient-centric and usable for clinicians. Conclusions The electronic New Patient Intake Questionnaire allows for systematic collection of the PRD, which should benefit cancer care outcomes through innovative care delivery and healthcare interventions.

12115 Background: Monitoring electronic patient reported outcomes (ePROs) has demonstrated impact on quality of life and survival in oncology. Maintaining high response rates to ePRO measures is critical in routine care. We evaluate the routine care implementation of head and neck oncology (HNO)-focused ePROs and the impact of patient demographics and assignment method on response rate. Methods: Since October 2021, patients diagnosed with head and neck cancer (PHN) at Dana-Farber Cancer Institute (DFCI) have had the opportunity to respond to the EHR-integrated European Organisation for Research and Treatment of Cancer Quality of Life Questionnaire Head and Neck Module (EORTC QLQ- H&N43) at clinic visits, not to exceed every 30 days. PHN are also prompted at 7 and 14 days postoperative, regardless of clinic visit. HNO clinicians selected EORTC QLQ- H&N43 because of its actionable scores and limited overlap with cross-cutting ePRO tools at DFCI. Reviewed by Patient and Family Advisory Council members, PHN can respond to the questionnaire in English or Spanish via any internet-enabled device or tablet provided in clinic. Tablet assignment rates are sent via automated report to the HNO clinic manager. Results: Between October 2021 and January 2022, PHN responded to 64% of questionnaires for eligible clinic visits (1618/2535). Post-operatively, 65% of PHN responded to EORTC QLQ- H&N43 at least once within 28 days of surgery. Prompted at 7 and 14 days, PHN responded to 44% (133/300) of all post-operative questionnaires. Overall, PHN responded on their own device 50% of the time and on tablets in clinic 50% of the time. Response rates significantly associated with race, primary language, and age at clinic, but not post-operatively due to low sample size. PHN with a primary language other than English, older PHN, and PHN with races other than white responded less frequently, with the exception of Asian PHN in clinic who had the highest response rates. Clinician champions, EHR-integration, and a timely feedback loop to clinic managers facilitated response rates. Conclusions: Successful implementation of HNO ePROs is aided by clinical engagement and availability of real-time response rate data. ePRO response rate in HNO was found to be associated with race, primary language, age, and assignment method. Further work to focus on improving disparities within response rates and linking automatic interventions to scores is needed. [Table: see text]