Development of outcome indicators for monitoring the quality of public mental health care

Srebnik, Debra; Hendryx, Michael; Stevenson, Jennifer; Caverly, Susan; Dyck, Dennis G.; Cauce, Ana Mari

doi:10.1176/ps.48.7.903

Cited by 43 publications

(4 citation statements)

References 35 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In the 1990s, the growth of managed care delivery systems in behavioral health raised the need for quality assurance and accountability instruments, and led to an increase in the number of publications on the development of performance measures in scientific literature. A total of 121 measures for various aspects and dimensions of the performance of public mental health providers, services, and systems were proposed [20,22,24,25,27,29,33,36]. …”

Section: Resultsmentioning

confidence: 99%

“…Either by assessing the relation of a measure of satisfaction with an external criterion [17,22] or using measures of satisfaction as criteria for PMHC quality to study the usefulness of PI of PMHC processes and (clinical) outcomes [30,59,91,110]. Four of these studies show significant associations between the satisfaction measure with measures of effectiveness, appropriateness, accessibility, and responsiveness.…”

Section: Resultsmentioning

confidence: 99%

See 1 more Smart Citation

Performance indicators for public mental healthcare: a systematic international inventory

et al. 2012

View full text Add to dashboard Cite

BackgroundThe development and use of performance indicators (PI) in the field of public mental health care (PMHC) has increased rapidly in the last decade. To gain insight in the current state of PI for PMHC in nations and regions around the world, we conducted a structured review of publications in scientific peer-reviewed journals supplemented by a systematic inventory of PI published in policy documents by (non-) governmental organizations.MethodsPublications on PI for PMHC were identified through database- and internet searches. Final selection was based on review of the full content of the publications. Publications were ordered by nation or region and chronologically. Individual PI were classified by development method, assessment level, care domain, performance dimension, diagnostic focus, and data source. Finally, the evidence on feasibility, data reliability, and content-, criterion-, and construct validity of the PI was evaluated.ResultsA total of 106 publications were included in the sample. The majority of the publications (n = 65) were peer-reviewed journal articles and 66 publications specifically dealt with performance of PMHC in the United States. The objectives of performance measurement vary widely from internal quality improvement to increasing transparency and accountability. The characteristics of 1480 unique PI were assessed. The majority of PI is based on stakeholder opinion, assesses care processes, is not specific to any diagnostic group, and utilizes administrative data sources. The targeted quality dimensions varied widely across and within nations depending on local professional or political definitions and interests. For all PI some evidence for the content validity and feasibility has been established. Data reliability, criterion- and construct validity have rarely been assessed. Only 18 publications on criterion validity were included. These show significant associations in the expected direction on the majority of PI, but mixed results on a noteworthy number of others.ConclusionsPI have been developed for a broad range of care levels, domains, and quality dimensions of PMHC. To ensure their usefulness for the measurement of PMHC performance and advancement of transparency, accountability and quality improvement in PMHC, future research should focus on assessment of the psychometric properties of PI.

show abstract

Section: Resultsmentioning

confidence: 99%

Section: Resultsmentioning

confidence: 99%

Performance indicators for public mental healthcare: a systematic international inventory

et al. 2012

View full text Add to dashboard Cite

show abstract

“…There are international calls for consumer and carer participation in all levels of mental health service development, delivery, and evaluation, and the evidence base is growing (Patel, Bakken, & Ruland, 2008). Early evidence supported positive outcomes related to consumers and carers participating in training mental health workers (Simpson & House, 2003), monitoring services (Srebnik et al, 1997) and planning services through committees (Crawford et al, 2003). Research supports the effectiveness of consumer-led services, such as self-help groups (Chinman et al, 2014;Doughty & Tse, 2011), and some have argued that consumer-led services may serve as alternatives to conventional psychiatry (see Russo & Sweeney, 2016).…”

Section: Introductionmentioning

confidence: 99%

Consumer and carer perspectives in the development of a mental health research, treatment and teaching facility: A thematic analysis

Katsikitis

Lane

Ozols

et al. 2017

Psychiatric Ment Health Nurs

View full text Add to dashboard Cite

Introduction Recovery-oriented mental health policies recognize consumer and carer participation in service decision-making as essential, but little is known about the views of these individuals in the earliest stages of service development. Aim This study sought consumer and carer perspectives addressing the establishment of a mental health research, treatment and teaching facility in their region. Methods Two 2-hr focus groups were conducted, with separate groups held for mental health consumers (n = 9) and carers (n = 9), respectively. Discussions pertained to mental health literacy, gaps in current services, desires for an ideal facility (in terms of physical design and services offered) and what would help in recovery. Results Inductive thematic analysis was used to generate three themes: care outside of consultations, carer involvement in recovery and holistic approaches to mental health care. Consumers desired a facility that could cater to individual needs. Carers felt excluded in recovery and unable to provide effective support. Both groups preferred holistic approaches to mental health, expressing ambivalence towards medication and hospitalization. Discussion Consumers and carers have many needs that conventional practices may not meet. Implications for practice They have clear desires for equal partnership in recovery and for transformation of conventional treatment methods.

show abstract

“…By providing regular information to both the professional and the client on the course and severity of symptoms during treatment, routine outcome monitoring is assumed to improve informed decision making and therefore quality of care. Well-timed information on the severity and course of symptoms during treatment is an integral part of routine outcome monitoring [8,9]. Increased workload due to systematic data collection, such as filling out questionnaires multiple times, can easily lead to resistance by clinicians [10].…”

Section: Introductionmentioning

confidence: 99%

Clinicians’ Perspectives on a Web-Based System for Routine Outcome Monitoring in Old-Age Psychiatry in the Netherlands

Veerbeek¹,

Voshaar²,

Pot

2012

J Med Internet Res

View full text Add to dashboard Cite

BackgroundIn health care, the use of physical parameters to monitor physical disease progress is common. In mental health care, the periodic measurement of a client’s functioning during treatment, or routine outcome monitoring, has recently become important. Online delivery of questionnaires has the potential to reduce clinicians’ resistance to the implementation of routine outcome monitoring. Online delivery enables clinicians to receive results on a questionnaire in a graphic directly after data entry. This gives them insight into the progress of a client at a single glance.ObjectiveTo explore clinicians’ perspectives on a routine outcome monitoring procedure where questionnaires and feedback on scores were delivered online. Questionnaires could also be filled out on paper and then entered into the online system by a research assistant.MethodsIn 2009 we sent an online survey, consisting of five yes-or-no questions and six open-ended questions, to all clinicians in the 14 mental health care organizations working with the routine outcome monitoring system in the Netherlands. Of the 172 clinicians contacted, 80 (47%) opened the link and 70 of these 80 (88%) clinicians completed the survey.ResultsClinicians seldom used the graphical feedback from the Web-based system, which indicates that direct feedback on scores did not enhance the implementation of routine outcome monitoring. Integration into the electronic patient record and more training on interpretation and implementation of feedback in daily practice were seen as the primary points for further improvement. It was mainly the availability of a research assistant that made the routine outcome monitoring procedure feasible.ConclusionsWithout a research assistant and training in the interpretation of outcomes, software programs alone cannot ensure effective implementation of monitoring activities in everyday practice.

show abstract

Development of outcome indicators for monitoring the quality of public mental health care

Cited by 43 publications

References 35 publications

Performance indicators for public mental healthcare: a systematic international inventory

Performance indicators for public mental healthcare: a systematic international inventory

Consumer and carer perspectives in the development of a mental health research, treatment and teaching facility: A thematic analysis

Clinicians’ Perspectives on a Web-Based System for Routine Outcome Monitoring in Old-Age Psychiatry in the Netherlands

Contact Info

Product

Resources

About