Effects of Response Instructions on Faking a Situational Judgment Test

Nguyen, Nhung T.; Biderman, Michael D.; McDaniel, Michael A.

doi:10.1111/j.1468-2389.2005.00322.x

Cited by 84 publications

(114 citation statements)

References 34 publications

Supporting

Mentioning

102

Contrasting

Unclassified

Order By: Relevance

“…It would be interesting to investigate the effects of elaboration on SJTs with knowledge-based instructions ('indicate the best answer'). Such SJTs have already been found to be less susceptible to faking (Nguyen et al, 2005). Another direction for future research is to examine whether elaboration is still useful when the SJT content is more cognitively oriented (e.g., SJT as a measure of procedural job knowledge).…”

Section: Discussionmentioning

confidence: 99%

“…One stream of studies compared responses obtained under different instruction sets (honest and fake-good instructions). Generally, this body of research was conducted in a laboratory setting and aimed to determine the maximal limits of capability to fake on SJTs when instructed to do so (e.g., Juraska & Drasgow, 2001;Nguyen, McDaniel, & Biderman, 2005;Peeters & Lievens, 2005). Another strand of research involved field studies, comparing responses from various groups (e.g., students, applicants, and incumbents).…”

Section: Response Distortion and Sjtsmentioning

confidence: 99%

“…In the 'fake' conditions, they were instructed to make the best impression, to answer as they were taking part in a college admission exam wherein they tried to get the highest scores. These instructions were adapted from previous studies (e.g., McFarland & Ryan, 2000;Nguyen et al, 2005).…”

Section: Experimental Designmentioning

confidence: 99%

See 2 more Smart Citations

Impact of Elaboration on Responding to Situational Judgment Test Items

Lievens

Peeters

2008

Int J Selection Assessment

View full text Add to dashboard Cite

Although faking has been identified as a potential problem in situational judgment tests (SJTs), no studies have investigated proactive approaches for controlling faking in SJTs. Therefore, this study examined the impact of elaboration on responding to SJT items. Elaboration was operationalized as reason-giving. Two hundred and forty-seven master students were assigned to either an honest or a fake condition, and to a non-elaboration or an elaboration condition. Results showed that elaboration decreased the effect of faking for items with high familiarity. Elaboration on familiar items also decreased the percentage of fakers in the top of the distribution. Next, participants in the elaboration condition rated the SJT significantly higher in terms of allowing them to present themselves more realistically and to demonstrate their knowledge, skills, and abilities. Finally, there were no significant differences in participants' satisfaction with the SJT across the elaboration and non-elaboration condition.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Response Distortion and Sjtsmentioning

confidence: 99%

See 1 more Smart Citation

Impact of Elaboration on Responding to Situational Judgment Test Items

Lievens

Peeters

2008

Int J Selection Assessment

View full text Add to dashboard Cite

show abstract

“…Given that the reduction in subgroup differences is considered to be one of the key benefits of SJTs over other selection methods (compared to academic attainment), this may pose a significant challenge to test developers. Conversely, research shows behavioural tendency instructions are more susceptible to 'faking', similar to personality tests (Nguyen et al 2005, Birkeland et al 2006; and thus the balance of the costs and benefits of each response format must be considered when defining the specification of an SJT. Given that medical selection is competitive, it could be argued that knowledge based formats may be more appropriate for this high-stakes selection context, since SJTs are a measure of maximal performance (i.e.…”

Section: Response Formatsmentioning

confidence: 99%

Situational judgement tests in medical education and training: Research, theory and practice: AMEE Guide No. 100

Patterson¹,

Zibarras²,

Ashworth³

2015

Medical Teacher

175

228

View full text Add to dashboard Cite

This is the accepted version of the paper.This version of the publication may differ from the final published version. Vicki specialises in the fields of assessment and selection, evaluation and organisational development, delivering bespoke solutions to public and private sector clients in the UK and internationally. Permanent repository link Acknowledgements:We especially would like to thank Anna Rosselli and Fran Cousans for their support in preparing the final manuscript. reactions to a number of hypothetical role-relevant scenarios, which reflect situations candidates are likely to encounter in the target role. These scenarios are based on a detailed analysis of the role and should be developed in collaboration with subject matter experts, in order to accurately assess the key attributes that are associated with competent performance.From a theoretical perspective, SJTs are believed to measure prosocial Implicit Trait Policies (ITPs), which are shaped by socialisation processes that teach the utility of expressing certain traits in different settings such as agreeable expressions (e.g. helping others in need), or disagreeable actions (e.g. advancing ones own interest at others expense).

show abstract

“…Second, more transparent items were more fakable. Third, the type of response instructions was a key factor as it affected the cognitive loading and amount of response distortion in SJTs (Nguyen et al, 2005b;Ployhart and Ehrhart, 2003). Behavioural tendency instructions were more fakable than knowledge-based instructions.…”

Section: Fakabilitymentioning

confidence: 99%

Situational judgment tests: a review of recent research

2008

View full text Add to dashboard Cite

Purpose -The purpose of this paper is to give an empirically-based review of the strengths and weaknesses of situational judgment tests (SJTs). Design/methodology/approach -The features, history, and development of SJTs are discussed. Next, a computerized search (from 1990-2007) is conducted to retrieve empirical studies related to SJTs. The effectiveness of SJTs is discussed in terms of reliability, criterion-related validity, incremental validity, construct-related validity, utility, adverse impact, applicant perceptions, fakability, and susceptibility to practice and coaching effects. Findings -Strengths of SJTs are that they show criterion-related validity and incremental validity above cognitive ability and personality tests. SJTs have also less adverse impact towards minorities (especially if the cognitive loading of the SJT is low). Furthermore, applicant reactions towards SJTs are positive and SJTs enable to test large applicant groups at once (through the Internet). In terms of weaknesses, SJTs might be prone to faking, practice, and coaching effects. There is also debate about what constructs are measured by SJTs. Research limitations/implications -Five avenues for future research are discussed: construct-related validity of SJTs, utility of SJTs vis-à -vis other predictors, impact of SJT features on validity and adverse impact, examination of alternative stimulus and response formats, and cross-cultural transportability of SJTs. Practical implications -Practitioners receive evidence-based information about the features, development, and strengths and weaknesses of SJTs. Originality/value -Apart from the USA, SJTs have not made strong inroads in selection practice in Europe and other parts of the world. This evidence-based paper might highlight the value of SJTs.

show abstract

Effects of Response Instructions on Faking a Situational Judgment Test

Cited by 84 publications

References 34 publications

Impact of Elaboration on Responding to Situational Judgment Test Items

Impact of Elaboration on Responding to Situational Judgment Test Items

Situational judgement tests in medical education and training: Research, theory and practice: AMEE Guide No. 100

Situational judgment tests: a review of recent research

Contact Info

Product

Resources

About