Development of Performance Dashboards in Healthcare Sector: Key Practical Issues

Ghazisaeidi, Marjan; Safdari, Reza; Torabi, Mashallah; Mirzaee, Moghaddameh; Farzi, Jebraeil; Goodini, Azadeh

doi:10.5455/aim.2015.23.317-321

Cited by 85 publications

(84 citation statements)

References 29 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Users valued the ability to tailor a system to individual and organisational needs. 94,[97][98][99][100] This functionality could include personalised alerts and reminders, 77,79,93,[100][101][102] the option to set default filters 75,87 and the ability to pin particular information to the screen to appear at all times, enabling comparisons. 77 Benefits were also reported from being able to dynamically add, remove and adjust elements of the system to fit the user's focus and workflow.…”

Section: Flexibility and Individualisationmentioning

confidence: 99%

“…74,82,103 The appropriate style to use when presenting the data is highly related to the nature of the data set and its audience, and, hence, it was recommended in four studies that the user is presented with a choice of graphs, dials or tables that can be adapted to individual preferences. 74,82,[102][103][104]…”

Section: Flexibility and Individualisationmentioning

confidence: 99%

“…Study authors considered a simple-to-follow, clear layout that anticipates the user's workflow as key to usability. 75,87,90,102,103,105 Faster interpretation of the data is enabled by applying colour to emphasise differentiations and by adopting 'most common' lists. 79 Scrolling should be avoided or limited according to study authors, 89,96,106 and information should always be accessible in as few mouse clicks as possible.…”

Section: Usability and Navigationmentioning

confidence: 99%

“…Dashboards are more likely to be adopted if, in addition to highlighting problems, they offer recommendations for solving them. 92,102 This may include signposting to other sources of information and support. 76,93,97,107 Discussion and impact on the project…”

Section: Community Featuresmentioning

confidence: 99%

See 3 more Smart Citations

Automated analysis of free-text comments and dashboard representations in patient experience surveys: a multimethod co-design study

Rivas

Tkacz

Antao

et al. 2019

Health Serv Deliv Res

View full text Add to dashboard Cite

Background Patient experience surveys (PESs) often include informative free-text comments, but with no way of systematically, efficiently and usefully analysing and reporting these. The National Cancer Patient Experience Survey (CPES), used to model the approach reported here, generates > 70,000 free-text comments annually. Main aim To improve the use and usefulness of PES free-text comments in driving health service changes that improve the patient experience. Secondary aims (1) To structure CPES free-text comments using rule-based information retrieval (IR) (‘text engineering’), drawing on health-care domain-specific gazetteers of terms, with in-built transferability to other surveys and conditions; (2) to display the results usefully for health-care professionals, in a digital toolkit dashboard display that drills down to the original free text; (3) to explore the usefulness of interdisciplinary mixed stakeholder co-design and consensus-forming approaches in technology development, ensuring that outputs have meaning for all; and (4) to explore the usefulness of Normalisation Process Theory (NPT) in structuring outputs for implementation and sustainability. Design A scoping review, rapid review and surveys with stakeholders in health care (patients, carers, health-care providers, commissioners, policy-makers and charities) explored clinical dashboard design/patient experience themes. The findings informed the rules for the draft rule-based IR [developed using half of the 2013 Wales CPES (WCPES) data set] and prototype toolkit dashboards summarising PES data. These were refined following mixed stakeholder, concept-mapping workshops and interviews, which were structured to enable consensus-forming ‘co-design’ work. IR validation used the second half of the WCPES, with comparison against its manual analysis; transferability was tested using further health-care data sets. A discrete choice experiment (DCE) explored which toolkit features were preferred by health-care professionals, with a simple cost–benefit analysis. Structured walk-throughs with NHS managers in Wessex, London and Leeds explored usability and general implementation into practice. Key outcomes A taxonomy of ranked PES themes, a checklist of key features recommended for digital clinical toolkits, rule-based IR validation and transferability scores, usability, and goal-oriented, cost–benefit and marketability results. The secondary outputs were a survey, scoping and rapid review findings, and concordance and discordance between stakeholders and methods. Results (1) The surveys, rapid review and workshops showed that stakeholders differed in their understandings of the patient experience and priorities for change, but that they reached consensus on a shortlist of 19 themes; six were considered to be core; (2) the scoping review and one survey explored the clinical toolkit design, emphasising that such toolkits should be quick and easy to use, and embedded in workflows; the workshop discussions, the DCE and the walk-throughs confirmed this and foregrounded other features to form the toolkit design checklist; and (3) the rule-based IR, developed using noun and verb phrases and lookup gazetteers, was 86% accurate on the WCPES, but needs modification to improve this and to be accurate with other data sets. The DCE and the walk-through suggest that the toolkit would be well accepted, with a favourable cost–benefit ratio, if implemented into practice with appropriate infrastructure support. Limitations Small participant numbers and sampling bias across component studies. The scoping review studies mostly used top-down approaches and focused on professional dashboards. The rapid review of themes had limited scope, with no second reviewer. The IR needs further refinement, especially for transferability. New governance restrictions further limit immediate use. Conclusions Using a multidisciplinary, mixed stakeholder, use of co-design, proof of concept was shown for an automated display of patient experience free-text comments in a way that could drive health-care improvements in real time. The approach is easily modified for transferable application. Future work Further exploration is needed of implementation into practice, transferable uses and technology development co-design approaches. Funding The National Institute for Health Research Health Services and Delivery Research programme.

show abstract

Section: Flexibility and Individualisationmentioning

confidence: 99%

Section: Flexibility and Individualisationmentioning

confidence: 99%

Section: Usability and Navigationmentioning

confidence: 99%

Section: Community Featuresmentioning

confidence: 99%

See 2 more Smart Citations

Automated analysis of free-text comments and dashboard representations in patient experience surveys: a multimethod co-design study

Rivas

Tkacz

Antao

et al. 2019

Health Serv Deliv Res

View full text Add to dashboard Cite

show abstract

“…Finally, the systematic approach to CQI of examining performance relative to targets requires the integration of real-time data, dashboards, and reports powered by information technology and informatics frameworks [15,16].…”

Section: Ojphimentioning

confidence: 99%

Building and launching an online quality improvement information exchange for home visiting programs in Missouri

Kennedy

Boren

Kapp

et al. 2017

OJPHI

View full text Add to dashboard Cite

Continuous quality improvement initiatives (CQII) in home visiting programs have traditionally occurred within a local implementing agency (LIA), parent organization, or funding provision. In Missouri, certain LIAs participate in the Missouri Maternal, Infant, and Early Childhood Home Visiting program (MIECHV). Their CQII activities and the coordination of CQI efforts across agencies are limited to quarterly meetings to discuss barriers to service delivery and newsletters. Their designed CQI process does not include evaluation of program fidelity or assessment nor supports to assist with identifying and prioritizing areas where improvement is needed. Therefore, much of LIA CQII are often lost to the benefit of external agencies facing similar challenges. We developed a virtual environment, the Missouri MIECHV Gateway, for CQII activities. The Gateway promotes and supports quality improvement for LIAs while aligning stakeholders from seven home visiting LIAs. Development of the Gateway environment aims to complement the existing MIECHV CQI framework by: 1) adding CQI elements that are missing or ineffective, 2) adding elements for CQI identification and program evaluation, and 3) offering LIAs a network to share CQI experiences and collaborate at a distance. This web-based environment allows LIA personnel to identify program activities in need of quality improvement, and guides the planning, implementation, and evaluation of CQII. In addition, the Gateway standardizes quality improvement training, collates overlapping resources, and supports knowledge translation, thus aimed to improve capacity for measurable change in organizational initiatives. This interactive web-based portal provides the infrastructure to virtually connect and engage LIAs in CQI and stimulate sharing of ideas and best practices. This article describes the characteristics, development, build, and launch of this quality improvement practice exchange virtual environment and present results of three usability pilot tests and the site launch. Briefly, prior to deployment to 58 users, usability pilot testing of the site occurred in three stages, to three defined groups. Pilot testing results were overall positive, desirable, and vital to improving the site prior to the full-launch. The majority of reviewers stated they would access and use the learning materials (87%), use the site for completing CQII (80%), and reported that the site will benefit their work teams in addressing agency challenges (66%). The majority of reviewers also approved of the developed fidelity assessment: as, easy to use (79%), having a clear purpose (86%), providing value in selfidentification of CQII (75%), and recommendations were appropriate (79%). The System Usability Scale (SUS) score increased (10%) between pilot groups 2 and 3, with a mean SUS score of 71.6, above

show abstract

Dimensions of performance and related key performance indicators addressed in healthcare organisations: A literature review

Gartner

Lemaire

2022

Health Planning & Management

View full text Add to dashboard Cite

Introduction: Performance measurement systems have become essential managerial tools for healthcare organisations in the last few decades. They allow hospital managers to pilot their institution and assess the development of the organisation in helping managers in decision-making and viewing the different impacts of these decisions. However, there is a need to investigate further the dimensions of performance those performance measurement systems address. Methods: A literature review was primarily conduced about performance measures in healthcare organisations. A comparative study was secondly made to identify the different performance dimensions that are present in the literature during the last decade. Forty-nine studies were considered and sixteen proposal frameworks were used to make the comparative analyses. Results: We classified dimensions depending on the frequency of mobilisation of their components in four categories: the stars, the first runners-up, the opportunists and the forgotten ones. For each of the dimensions presented in this classification, the main types of KPIs proposed in the theoretical frameworks are presented. A discussion on relevance and possible blind spots is then conducted. Conclusion: Although they were a lot of proposal frameworks of KPI proposed in the last decades to assess healthcare organisations, some dimensions remain underrepresented. There is still a need to develop structure KPI and

show abstract

Development of Performance Dashboards in Healthcare Sector: Key Practical Issues

Cited by 85 publications

References 29 publications

Automated analysis of free-text comments and dashboard representations in patient experience surveys: a multimethod co-design study

Automated analysis of free-text comments and dashboard representations in patient experience surveys: a multimethod co-design study

Building and launching an online quality improvement information exchange for home visiting programs in Missouri

Dimensions of performance and related key performance indicators addressed in healthcare organisations: A literature review

Contact Info

Product

Resources

About