On the Construct-Related Validity of Implicit Trait Policies

Freudenstein, Jan‐Philipp; Mussel, Patrick; Krumm, Stefan

doi:10.1177/08902070211056901

Cited by 4 publications

(5 citation statements)

References 65 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Two recent studies took a closer look at key positions of the debate about the underlying processes of SJT performance. First, Freudenstein et al (2023) demonstrated that typical operationalizations of SJTs are not in line with the conceptualization as measures of general domain knowledge. Specifically, results showed that reliable variance in SJT scores is to a larger degree test‐specific rather than context‐independent, even when SJTs measured the same construct.…”

Section: Theoretical Backgroundmentioning

confidence: 99%

The influence of situational strength on the relation of personality and situational judgment test performance

Freudenstein

Schäpers

Reznik

et al. 2023

Int J Selection Assessment

Self Cite

View full text Add to dashboard Cite

Situational strength theory has been used as a theoretical underpinning of person–situation processes that are linked to job performance. Accordingly, the link between personality traits and job performance increases in weak situations. Building on this research, similar mechanisms have been proposed for simulation‐based selection tools, such as Situational Judgment Tests (SJTs), to explain how these measures work as predictors of job performance. However, underlying processes of SJT performance are subject to debate with some scholars arguing in favor of context‐independent processes while others maintain that situations play an essential role. This study (N = 707) examined whether the strength of situations in SJT items moderated the relation between personality and SJT performance. Results did not support the notion that personality is more strongly related to SJT performance when situations are weak. In fact, for some traits, the opposite may be true as more situational constraints led to an increase in the relation of extraversion, emotional stability, and SJT performance. The results add to an increasing body of research about psychological processes in SJTs. Limitations and implications for research and practice are discussed.

show abstract

Section: Theoretical Backgroundmentioning

confidence: 99%

The influence of situational strength on the relation of personality and situational judgment test performance

Freudenstein

Schäpers

Reznik

et al. 2023

Int J Selection Assessment

Self Cite

View full text Add to dashboard Cite

show abstract

“…Second, SJTs represent a collection of methods rather than a specific assessment of definite constructs (Freudenstein et al, 2021; Lievens, Peeters, et al, 2008). Different SJTs vary in their response medium, response format, instruction format, scoring method, and more (Campion et al, 2014).…”

Section: Discussionmentioning

confidence: 99%

“…Second, SJTs represent a collection of methods rather than a specific assessment of definite constructs (Freudenstein et al, 2021;Lievens, Peeters, et al, 2008) SJTs vary in their response medium, response format, instruction format, scoring method, and more (Campion et al, 2014). The common core of most SJTs is the inclusion of a work-related situation description and the focus on the prediction of external criteria such as job performance (Christian et al, 2010;Corstjens et al, 2017) Motowidlo, 2016).…”

Section: Standardized State Assessment and Situational Judgment Testsmentioning

confidence: 99%

Standardized State Assessment

Freudenstein,

Schulze,

Schäpers

et al. 2023

European Journal of Psychological Assessment

Self Cite

View full text Add to dashboard Cite

Contemporary theories of personality require psychological assessments that take person-situation processes into account. This is most commonly achieved via ambulatory assessments that sample individuals within their real-life environments. An alternative approach aims at measuring person-situation processes by incorporating hypothetical situation descriptions. However, thus far, no detailed guidelines exist on how to develop such measures so that they validly assess person-situation processes. In this article, we propose Standardized State Assessment as a methodological framework for the assessment of situation-specific states in hypothetical situations. We build on theoretical advances in personality research and previous assessment approaches to derive guidelines for a theory-driven development of hypothetical situation descriptions. We further describe how states should be measured in these situations. Finally, we propose that appropriate latent measurement models and validation strategies may help to develop assessments that are similar to real-life person-situation processes. In the first empirical example ( N = 238), we demonstrate the suitability of the framework. Standardized State Assessment may offer economically advantageous alternatives for research or applied settings in which ambulatory assessments are unfeasible. Moreover, we discuss how this framework may help to answer theoretical questions on person-situation processes.

show abstract

“…Traditionally, an ITP is validated by observing the correlation between the trait dimension (e.g., cultural empathy) and the effectiveness of the ITP of said trait dimension (e.g., cultural empathy ITP) ( Motowidlo et al, 2006 ). This correlation is called the saturation of the ITP, which is not always a very strong one ( Freudenstein et al, 2023 ). As a consequence, some accounts in literature have criticized this traditional approach, clearly stating that the variance of an ITP over individuals is not determined by personality alone, but can also include elements like experience, attitudes, motivation and learning ( Oostrom et al, 2012 ; Lievens and Motowidlo, 2016 ).…”

Section: Introductionmentioning

confidence: 99%

“…Instruments that leave out one or more known dimensions of more broad theoretical concepts (e.g., the Big Five of human personality) can endanger the validity of correlation and regression estimates through the omitted variable problem, as the estimated relations are prone to bias (i.e., in the present research’s case an underestimation of saturation) by leaving important elements (e.g., one or more personality dimensions or elements of experience, attitudes, motivation, and learning) out of the equation ( Sackett et al, 2003 ). As a consequence, there are already accounts in literature that disavow the (single) trait specificity of the ITP construct ( Freudenstein et al, 2023 ).…”

Section: Introductionmentioning

confidence: 99%

Presenting the direct intercultural effectiveness simulation: an implicit trait policy on intercultural competence

Schelfhout

Derous

2023

Front. Psychol.

View full text Add to dashboard Cite

BackgroundAn implicit trait policy (ITP) represents the interaction between a personal disposition and general domain knowledge on how to effectively handle a specific (intercultural) situation. Such an ITP is a proven construct to create instruments that can predict future effective behavior. Moreover, such a simulation can provide valuable proxies for actual (future) behavior, as measures of (future) real life intercultural interactions are not always available.MethodsIn a series of three studies (N1 = 224, N2 = 291, N3 = 478), the present research introduces a “Direct Intercultural Effectiveness Simulation” or DIES, an instrument that simulates intercultural effectiveness by directly tapping into an ITP on intercultural competence.ResultsFirst and foremost, the present research demonstrates that the DIES instrument generates reliable and construct-valid measures of intercultural effectiveness. Second, the DIES instrument also shows expected converging and diverging patterns when correlated with a nomological network on intercultural effectiveness. And third, the DIES measure is further validated by integration into an ITP framework of intercultural effectiveness based on theoretical and empirical accounts from literature.ConclusionThe DIES instrument generates a reliable and valid measure of intercultural effectiveness by tapping into an ITP on intercultural competence. Theoretically, the present research integrates the instrument into literature by empirically verifying an ITP framework of intercultural effectiveness. In practice, the DIES instrument can be used as an awareness or training proxy for actual behavior to tackle important problems like ethnic prejudice and discrimination.

show abstract

On the Construct-Related Validity of Implicit Trait Policies

Cited by 4 publications

References 65 publications

The influence of situational strength on the relation of personality and situational judgment test performance

The influence of situational strength on the relation of personality and situational judgment test performance

Standardized State Assessment

Presenting the direct intercultural effectiveness simulation: an implicit trait policy on intercultural competence

Contact Info

Product

Resources

About