Assessing the Construct Validity of Rational Biodata Scales

Development of Experimental Army Enlisted Personnel Selection and Classification Tests and Job Performance Criteria

“…By far the largest effect size was observed with the RBI Lie scale, indicating that this scale is sensitive to deliberate response distortion. Taken together with previous research demonstrating a high correlation between this scale and the Army Assessment of Background and Life Experiences (ABLE) Lie scale (Kilcullen et al, 1995), the results support the construct validity of the RBI Lie scale. Aside from the RBI Lie scale, two biodata scales showed an effect size greater than 1.0, although all of the effect sizes were statistically significant.…”

“…The scored item responses are then summed to form scale scores having substantive meaning. These scales typically show good convergent and discriminant validity, with personality "marker" scales measuring the same attributes and lower correlations with scales designed to detect socially desirable responding compared to the personality measures (Kilcullen, White, Mumford, & Mack, 1995).…”

“…Item scoring for the Lie scale is based on the endorsement of unlikely virtues. Previous research indicates that this scale shows good convergent and discriminant validity with a previously validated temperament scale measuring the same type of response distortion (Kilcullen et al, 1995). Since the goal of Select2l is to develop selection tests for operational use where faking on self-report measures is a concern, the Lie scale in this research was used as one criterion for eliminating pilot items.…”

Selection for Accelerated Basic Combat Training

“…The RBI is an expanded, updated version of the Test of Adaptable Personality (TAP), that was used to predict the performance of Special Operations Forces (SOF) officers and enlisted Soldiers in the field (Kilcullen, Goodwin, Chen, Wisecarver, & Sanders, 2002;Kilcullen, Mael, Goodwin, & Zazanis, 1999;Kilcullen, Putka, McCloy, and Van Iddekinge 2005). The RBI demonstrates good convergent and discriminant validity with standard, off-the-shelf temperament measures (Kilcullen, White, Mumford, & Mack, 1995), and significantly predicts enlisted job performance in conventional units (Kilcullen, Putka, & McCloy, 2007). It also includes a Lie Scale to detect socially desirable response patterns to help to counteract respondents misrepresenting themselves either intentionally or unintentionally.…”

Identifying and Assessing Interaction Knowledges, Skills, and Attributes for Objective Force Soldiers

“…The validity of biographical information or data (or biodata) has been demonstrated in several previous studies (Hunter & Hunter, 1984;White & Young, 1998;Young, Heggestad, Rumsey, & White, 2000). Previous research has also shown that biodata scales can be used to measure personality constructs, have higher criterion-related validity, and are less easily faked than traditional self-report personality assessments (KilcuUen, White, Mumford, & Mack, 1995). In comparison to alternative measures, biodata forms are feasible for group administration and scoring at a lower cost and are generally accepted by employers and the courts.…”