The State of Research on Situational Judgment Tests: A Content Analysis and Directions for Future Research

Campion, Michael C.; Ployhart, Robert E.; MacKenzie, William I.

doi:10.1080/08959285.2014.929693

Cited by 80 publications

(98 citation statements)

References 85 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…However, the integrity-based SJT used in this study was designed to measure one dimension, which might lead to a less serious violation of the assumption of unidimensionality. This is supported by a meta-analysis of Campion et al (2014) that reported a mean alpha of .57 across 129 coefficients (range 0-.92). In addition, it was shown that coefficient alpha was significantly higher for SJTs that had a larger focus on one dimension.…”

Section: Present Studysupporting

confidence: 50%

Scoring method of a Situational Judgment Test: influence on internal consistency reliability, adverse impact and correlation with personality?

Leng

Stegers‐Jager

Husbands

et al. 2016

Adv in Health Sci Educ

View full text Add to dashboard Cite

Situational Judgment Tests (SJTs) are increasingly used for medical school selection. Scoring an SJT is more complicated than scoring a knowledge test, because there are no objectively correct answers. The scoring method of an SJT may influence the construct and concurrent validity and the adverse impact with respect to non-traditional students. Previous research has compared only a small number of scoring methods and has not studied the effect of scoring method on internal consistency reliability. This study compared 28 different scoring methods for a rating SJT on internal consistency reliability, adverse impact and correlation with personality. The scoring methods varied on four aspects: the way of controlling for systematic error, and the type of reference group, distance and central tendency statistic. All scoring methods were applied to a previously validated integrity-based SJT, administered to 931 medical school applicants. Internal consistency reliability varied between .33 and .73, which is likely explained by the dependence of coefficient alpha on the total score variance. All scoring methods led to significantly higher scores for the ethnic majority than for the non-Western minorities, with effect sizes ranging from 0.48 to 0.66. Eighteen scoring methods showed a significant small positive correlation with agreeableness. Four scoring methods showed a significant small positive correlation with conscientiousness. The way of controlling for systematic error was the most influential scoring method aspect. These results suggest that the increased use of SJTs for selection into medical school must be accompanied by a thorough examination of the scoring method to be used.

show abstract

Section: Present Studysupporting

confidence: 50%

Scoring method of a Situational Judgment Test: influence on internal consistency reliability, adverse impact and correlation with personality?

Leng

Stegers‐Jager

Husbands

et al. 2016

Adv in Health Sci Educ

View full text Add to dashboard Cite

show abstract

“…In this way, the original MQ Test presents a relatively common characteristic in situations judgment tests (Campion et al, 2014;Motowidlo et al, 1991).…”

Section: Discussionmentioning

confidence: 99%

“…Remember that the low alpha coefficient is a common problem for measures where situations (e.g., descriptions or pictures) are used as clues, i.e., in situational judgment tests (c.f. Campion et al, 2014;Motowidlo et al, 1991).…”

Section: Discussionmentioning

confidence: 99%

“…Situational judgment tests (SJTs) were typically developed and applied in the domain of personnel psychology and assessment in the last 25 years (c.f., Campion, Ployhart, & MacKenzie, 2014;Motowidlo, Dunnette, & Carter, 1990). Most SJTs target the procedural knowledge of the individual in real life situa-tions, i.e.…”

Section: Measurement Of An Optimistic Mindset With a Situational Judgmentioning

confidence: 99%

See 1 more Smart Citation

Optimism and Well-Being in Hungarian Employees: First Application and Test of a Situational Judgment Approach to Explanatory Style

Kovács

Martos²

2017

View full text Add to dashboard Cite

Research on the explanatory style model of optimistic mindset has burgeoned in the la st decades. The present study presents the first examination of a new measure of the optimistic mindset, the MQ Test. The MQ Test u ses 3 6 persona l and work situations for prompting responses; however, it applies a situational judgment test approach. In the present study, crosssectional data with 437 Hungarian employees showed low to acceptable level of internal consistency and good test-retest reliability for the subscales. Exploratory and confirmative factor analyses provided evidence for separate sub-dimensions of negative (N) and positive (P) events. Accordingly, a 14 item Short MQ Test version was developed with P and N subscales. Structural equation models showed that P and N were differently and positively related to dispositional optimism, hope, self-esteem, self-efficacy and satisfaction with life. The limitations and potential merits of the MQ Test are discussed, along with its potential further development.

show abstract

“…Specificity of human thinking is such that even before starting activity, it has the ability to predict the result. The forecast of the result is a message to cognitive modeling and a powerful motivational factor of human behavior and activity (Campion, Ployhart, MacKenzie, 2014).…”

Section: Problem Statementmentioning

confidence: 99%

The Adequacy Of Personal Success Prediction In Psychological Achievement Testing

Makarevskaya¹

2017

The European Proceedings of Social and Behavioural Sciences

View full text Add to dashboard Cite

At the present time, a number of scientists are considering a psychological study "from the position of the subject", as an experimentally organized activity of the subject to perform a specific behavioral task. In this case, a person is included in the study as an integral object, and, consequently, the organization of research requires the consideration of the basic psychological regularities that determine the behavior of the individual in conditions appropriate to the situation of measurement.The article gives an overview of the research that reflects the features of predicting the success of subjects in various situations of psychological testing of professional and educational achievements.The article analyzes the adequacy of the personal forecast to the probable success in the "situation of expertise" and the "client situation". It is shown that in the situation of expert evaluation of achievements, the majority of subjects inadequately predict their chances of success, namely: they underestimate them. And one of the essential factors of the adequacy of a personal forecast of success can be assumed high self-esteem of their own level of knowledge.

show abstract

The State of Research on Situational Judgment Tests: A Content Analysis and Directions for Future Research

Cited by 80 publications

References 85 publications

Scoring method of a Situational Judgment Test: influence on internal consistency reliability, adverse impact and correlation with personality?

Scoring method of a Situational Judgment Test: influence on internal consistency reliability, adverse impact and correlation with personality?

Optimism and Well-Being in Hungarian Employees: First Application and Test of a Situational Judgment Approach to Explanatory Style

The Adequacy Of Personal Success Prediction In Psychological Achievement Testing

Contact Info

Product

Resources

About