Behaviorally Anchored Rating Scales: A Review of the Literature

Schwab, Donald P.; Heneman, Herbert G.; DeCotiis, Thomas A.

doi:10.1111/j.1744-6570.1975.tb01392.x

Cited by 175 publications

(74 citation statements)

References 25 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…l To negotiate entry, identify mutual RQs within the research brief and agree the process case study 178 (meets RQs 1, 2 and 3). l To engage participants in the research process (e.g.…”

Section: Research Engagement Processmentioning

confidence: 99%

“…peer-group pressure, minority influence). 178 A questionnaire is issued to 'experts' (often geographically dispersed) for their views, feedback on the results is given, least popular answers are removed, and second, and possibly subsequent, questionnaires are issued.…”

Section: Delphi Questionnaire Designmentioning

confidence: 99%

“…As such, they were said to help to 'ground' the scale in actual (recognisable and meaningful) behavioural descriptors to add clarity and enhance the validity and acceptability of the instrument. 178,[183][184][185][186] The aim in modifying the BARS questionnaire and in creating the anchors for the questionnaire was, as far as possible, to use the terminology of the respondents and illustrate the choices (dilemmas?) they face in their daily practice as decision-makers trying to use evidence.…”

Section: Delphi Questionnaire Designmentioning

confidence: 99%

“…Behaviourally Anchored Rating Scales are a form of Likert scale first used in organisational psychology, 178,[182][183][184] typically in instruments designed to standardise descriptions of employee performance appraisal (i.e. what would an 'excellent' performance as opposed to a 'poor' or 'average' performance actually look like).…”

Section: Delphi Questionnaire Designmentioning

confidence: 99%

See 3 more Smart Citations

Research utilisation and knowledge mobilisation in the commissioning and joint planning of public health interventions to reduce alcohol-related harms: a qualitative case design using a cocreation approach

Rushmer

Cheetham

Cox³

et al. 2015

Health Serv Deliv Res

View full text Add to dashboard Cite

Research utilisation and knowledge mobilisation in the commissioning and joint planning of public health interventions to reduce alcohol-related harms: a qualitative case design using a cocreation approach This report should be referenced as follows:Rushmer RK, Cheetham M, Cox L, Crosland A, Gray J, Hughes L, et al. Research utilisation and knowledge mobilisation in the commissioning and joint planning of public health interventions to reduce alcohol-related harms: a qualitative case design using a cocreation approach. Health Serv Deliv Res 2015;3(33). This journal is a member of and subscribes to the principles of the Committee on Publication Ethics (COPE) (www.publicationethics.org/). Health Services and Delivery ResearchEditorial contact: nihredit@southampton.ac.ukThe full HS&DR archive is freely available to view online at www.journalslibrary.nihr.ac.uk/hsdr. Print-on-demand copies can be purchased from the report pages of the NIHR Journals Library website: www.journalslibrary.nihr.ac.uk Criteria for inclusion in the Health Services and Delivery Research journalReports are published in Health Services and Delivery Research (HS&DR) if (1) they have resulted from work for the HS&DR programme or programmes which preceded the HS&DR programme, and (2) they are of a sufficiently high scientific quality as assessed by the reviewers and editors. HS&DR programmeThe Health Services and Delivery Research (HS&DR) programme, part of the National Institute for Health Research (NIHR), was established to fund a broad range of research. It combines the strengths and contributions of two previous NIHR research programmes: the Health Services Research (HSR) programme and the Service Delivery and Organisation (SDO) programme, which were merged in January 2012.The HS&DR programme aims to produce rigorous and relevant evidence on the quality, access and organisation of health services including costs and outcomes, as well as research on implementation. The programme will enhance the strategic focus on research that matters to the NHS and is keen to support ambitious evaluative research to improve health services.For more information about the HS&DR programme please visit the website: http://www.nets.nihr.ac.uk/programmes/hsdr This reportThe research reported in this issue of the journal was funded by the HS&DR programme or one of its preceding programmes as project number 09/1002/37. The contractual start date was in December 2011. The final report began editorial review in February 2014 and was accepted for publication in November 2014. The authors have been wholly responsible for all data collection, analysis and interpretation, and for writing up their work. The HS&DR editors and production house have tried to ensure the accuracy of the authors' report and would like to thank the reviewers for their constructive comments on the final report document. However, they do not accept liability for damages or losses arising from material published in this report.This report presents independent research funded by the National Institu...

show abstract

“…l To negotiate entry, identify mutual RQs within the research brief and agree the process case study 178 (meets RQs 1, 2 and 3). l To engage participants in the research process (e.g.…”

Section: Research Engagement Processmentioning

confidence: 99%

Section: Delphi Questionnaire Designmentioning

confidence: 99%

Section: Delphi Questionnaire Designmentioning

confidence: 99%

Section: Delphi Questionnaire Designmentioning

confidence: 99%

See 2 more Smart Citations

Research utilisation and knowledge mobilisation in the commissioning and joint planning of public health interventions to reduce alcohol-related harms: a qualitative case design using a cocreation approach

Rushmer

Cheetham

Cox³

et al. 2015

Health Serv Deliv Res

View full text Add to dashboard Cite

show abstract

“…An example of the behavioral anchors for one of the element of the Rescue tool can be found at Figure 1 Assessment scales with behavioral anchors are commonly used when assessing non-technical skills [23,24] . However, there is little evidence that behaviorally anchored scales are more superior to other forms of rating [29] .…”

Section: Developing the Tool And Rating Scalementioning

confidence: 99%

Assessing human factors during simulation: The development and preliminary validation of the rescue assessment tool

Unsworth

Melling

Allan

et al. 2014

JNEP

View full text Add to dashboard Cite

Northumbria University has developed Northumbria Research Link (NRL) to enable users to access the University's research output. Copyright © and moral rights for items on NRL are retained by the individual author(s) and/or other copyright owners. Single copies of full items can be reproduced, displayed or performed, and given to third parties in any format or medium for personal research or study, educational, or not-for-profit purposes without prior permission or charge, provided the authors, title and full bibliographic details are given, as well as a hyperlink and/or URL to the original metadata page. The content must not be changed in any way. Full items must not be sold commercially in any format or medium without formal permission of the copyright holder. The full policy is available online: http://nrl.northumbria.ac.uk/policies.html This document may differ from the final, published version of the research and has been made available online in accordance with publisher policies. To read and/or cite from the published version of the research, please visit the publisher's website (a subscription may be required.) AbstractBackground: Failure to rescue the deteriorating patient is a concern for all healthcare providers. In response to this problem providers have introduced a range of interventions to promote timely rescue. Human factors and non-technical skills play a part in both the recognition of ill patients and in the delivery of interventions associated with their successful rescue. Given the risks to patient safety which failure to rescue raises, simulation provides a vehicle for staff training and development in terms of both technical and non-technical skills. This paper describes the development and preliminary validation of a human factors rating tool specifically designed to assess the non-technical skills associated with the recognition and rescue of the deteriorating patient.Methods: Using high fidelity simulation scenarios related to patient deterioration Faculty independently rated student performance. Scoring took place using video footage of the students' performance. Data were analyzed to establish the validity of the tool, internal consistency between categories and elements and inter-rater reliability.Results: Content validity was established through a process of review and by checking for duplicate or redundant items. The internal consistency of the tool was acceptable with a Cronbach's alpha of 0.84. Factor analysis suggested that the tool assessed only two components rather than the three hypothesized during tool development. The components were labelled as recognizing and responding and leading and reassuring. Inter-rater reliability was initially poor at 0.21 but following training of raters this rose to above 0.8 for two videos related to the same scenario one which had been used during training. However, when the scenario changed the reliability dropped to 0.5. Conclusions:Rescue appears to be a well-structured tool with good levels of inter-rater reliability following intensive t...

show abstract

Exploring Methods for Developing Behaviorally Anchored Rating Scales for Evaluating Structured Interview Performance

Kell

Martín‐Raugh

Carney

et al. 2017

ETS Research Report Series

View full text Add to dashboard Cite

Since its 1947 founding, ETS has conducted and disseminated scientific research to support its products and services, and to advance the measurement and education fields. In keeping with these goals, ETS is committed to making its research freely available to the professional community and to the general public. Published accounts of ETS research, including papers in the ETS Research Report series, undergo a formal peer-review process by ETS staff to ensure that they meet established scientific and professional standards. All such ETS-conducted peer reviews are in addition to any reviews that outside organizations may provide as part of their own publication processes. Peer review notwithstanding, the positions expressed in the ETS Research Report series and other published accounts of ETS research are those of the authors and not necessarily those of the Officers and Trustees of Educational Testing Service.The Daniel Eignor Editorship is named in honor of Dr. Daniel R. Eignor, who from 2001 until 2011 served the Research and Development division as Editor for the ETS Research Report series. The Eignor Editorship has been created to recognize the pivotal leadership role that Dr. Eignor played in the research publication process at ETS. ETS Research Report Series ISSN 2330-8516 R E S E A R C H R E P O R T Exploring Methods for Developing Behaviorally Anchored Rating Scales for Evaluating Structured Interview PerformanceHarrison J. Kell, Michelle P. Martin-Raugh, Lauren M. Carney, Patricia A. Inglese, Lei Chen, & Gary FengEducational Testing Service, Princeton, NJ Behaviorally anchored rating scales (BARS) are an essential component of structured interviews. Use of BARS to evaluate interviewees' performance is associated with greater predictive validity and reliability and less bias. BARS are time-consuming and expensive to construct, however. This report explores the feasibility of gathering participants' responses to structured interview questions through an online crowdsourcing platform and using those responses to develop BARS. We describe the development of 12 structured interview questions to assess four applied social skills, elicitation of responses to these questions in the form of critical incidents from 68 respondents, and the creation of BARS from these critical incidents. Results indicate online participants are able to produce responses of sufficient quality to generate BARS for evaluating structured interview performance. We conclude by discussing limitations to this approach and future directions for research and practice.Keywords Amazon Mechanical Turk; behaviorally anchored rating scales; crowdsourcing; employment interviews; performance appraisal; social skills; structured interviews doi:10.1002/ets2.12152 Employment interviews are one of the most popular means of selecting personnel (Levashina, Hartwell, Morgeson, & Campion, 2014;McDaniel, Whetzel, Schmidt, & Maurer, 1994). Structured interviews that present all interviewees with the same standardized questions have higher validities for pre...

show abstract

Behaviorally Anchored Rating Scales: A Review of the Literature

Cited by 175 publications

References 25 publications

Research utilisation and knowledge mobilisation in the commissioning and joint planning of public health interventions to reduce alcohol-related harms: a qualitative case design using a cocreation approach

Research utilisation and knowledge mobilisation in the commissioning and joint planning of public health interventions to reduce alcohol-related harms: a qualitative case design using a cocreation approach

Assessing human factors during simulation: The development and preliminary validation of the rescue assessment tool

Exploring Methods for Developing Behaviorally Anchored Rating Scales for Evaluating Structured Interview Performance

Contact Info

Product

Resources

About