Exploring the Relationship Between Interrater Correlations and Validity of Peer Ratings

Kasten, Ronen; Nevo, Baruch

doi:10.1080/08959280801917792

Cited by 4 publications

(3 citation statements)

References 20 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…These results provide evidence to confirm our second hypothesis (less lenient and less range restricted cases will show higher interrater correlations) and show the importance of controlling contamination due to social desirability and/or leniency in performance measures. This concurs with previous research finding of correlation between raters expressing a combination of factors with different theoretical relationships with validity [ 39 , 17 ]. In this case, self-leniency may be one of these factors.…”

Section: Discussionsupporting

confidence: 93%

Relationships between Contextual and Task Performance and Interrater Agreement: Are There Any?

et al. 2015

View full text Add to dashboard Cite

Work performance is one of the most important dependent variables in Work and Organizational Psychology. The main objective of this paper was to explore the relationships between citizenship performance and task performance measures obtained from different appraisers and their consistency through a seldom-used methodology, intraclass correlation coefficients. Participants were 135 public employees, the total staff in a local government department. Jobs were clustered into job families through a work analysis based on standard questionnaires. A task description technique was used to develop a performance appraisal questionnaire for each job family, with three versions: self-, supervisor-, and peer-evaluation, in addition to a measure of citizenship performance. Only when the self-appraisal bias is controlled, significant correlations appeared between task performance rates. However, intraclass correlations analyses show that only self- (contextual and task) performance measures are consistent, while interrater agreement disappears. These results provide some interesting clues about the procedure of appraisal instrument development, the role of appraisers, and the importance of choosing adequate consistency analysis methods.

show abstract

Section: Discussionsupporting

confidence: 93%

Relationships between Contextual and Task Performance and Interrater Agreement: Are There Any?

et al. 2015

View full text Add to dashboard Cite

show abstract

“…The three raters' evaluations were averaged to calculate an index of group-based anger. Inter-rater reliability (a), computed using the most popular measure of the correlation between raters (Kasten & Nevo, 2008;Murphy & De Shon, 2000), was 0.90.…”

Section: Situational Group-based Angermentioning

confidence: 99%

Pathways to hostile collective action: The roles of general attitudes toward the advantaged group and situational anger

Zhou

Wang

2012

PsyCh Journal

View full text Add to dashboard Cite

Collective action is a group behavior that aims to improve the status, power, or influence of an entire group. The present study focused on hostile collective action performed for releasing negative emotions, and explored a pathway including the roles of general attitudes toward the advantaged group and situational group-based anger in predicting the disadvantaged groups' hostile collective action. Group-level data were collected via a laboratory experiment. The results obtained using multiple regression analysis suggested that general attitudes toward the advantaged group formed before the trigger event predicted hostile collective action indirectly through the mediating effects of situational group-based anger and collective action tendencies, which were both produced after that trigger event. In addition, situational group-based anger predicted hostile collective action fully through collective action tendencies. These pathways provided a continuous process of hostile collective action in which general attitudes toward the advantaged group that were formed before the trigger events would influence situational group-based anger when the trigger events occurred, and then affected hostile collective action for responding to these events. Thus, hostile collective action could be predicted before the trigger events by monitoring the disadvantaged groups' attitudes toward the advantaged group. Moreover, reducing destructive collective action by improving intergroup attitudes through some effective interventions was discussed in this study.

show abstract

“…Inter-and intra-rater Agreement of The Dynamic Movement assessment ™ root of the reliability coefficient 27 . DMA has a subjective nature and the decision of the evaluator can impact the ability to predict injuries25.…”

Section: Introductionmentioning

confidence: 99%

Intra and inter-rater agreement of the Dynamic Movement Assessment ™ Agreement of the DMA™

Bunn

Costa²,

Júnior³

et al. 2020

Motriz: rev. educ. fis.

View full text Add to dashboard Cite

Exploring the Relationship Between Interrater Correlations and Validity of Peer Ratings

Cited by 4 publications

References 20 publications

Relationships between Contextual and Task Performance and Interrater Agreement: Are There Any?

Relationships between Contextual and Task Performance and Interrater Agreement: Are There Any?

Pathways to hostile collective action: The roles of general attitudes toward the advantaged group and situational anger

Intra and inter-rater agreement of the Dynamic Movement Assessment ™ Agreement of the DMA™

Contact Info

Product

Resources

About