Reliability Generalization of the Patterns of Adaptive Learning Survey Goal Orientation Scales

Abstract

A reliability generalization study was completed on the Patterns of Adaptive Learning Survey achievement goal orientation scales to assess the prediction of (a) the different orientation scales, (b) the adaptation of items to meet research needs, (c) the number of respondents completing the instrument, and (d) the publication date cited for the manual used on reliability variation in articles that reported sample specific reliability coefficients. The results of analyses suggested that the evolution of the scales has improved the consistency of the scores derived, lending more credence to inferences that are based on the scores from the more recent versions of the instrument. Nevertheless, examples of poor to marginal coefficients were observed in some cases.Throughout the relatively short history of exploring an intersection between education and psychology, conceptualizations of motivation have shifted from broad mechanistic theories (see Hull, 1943, for an overview of early theories) to studies of individual social-cognitive aspects of motivation

Sustaining optimal motivation: A longitudinal analysis of interventions to broaden participation of underrepresented students in STEM.

“…A meta-analytic review of this scale among college samples indicated that the mean internal consistency reliability was α = .80 (Ross, Blackburn, & Forbes, 2005). …”

“…A meta-analytic review of this scale among college samples indicated that the mean internal consistency reliability was α = .85 (Ross et al, 2005). Additionally, in light of a recent meta-analysis, it is important to note that the PALS Performance-Approach scale has a mix of items related to normative and appearance goals (Hulleman et al, 2010).…”

Positive biases in self-assessment of mathematics competence, achievement goals, and mathematics performance

“…The PALS is one of the most widely used survey methods for assessing achievement goals and gives highly reliable and valid measurements of students' personal mastery, performance approach and performance avoidance goals (Anderman et al, 2005;Midgley et al, 1998;Ross, Blackburn, & Forbes, 2005). Five items assessed a mastery goal orientation (e.g., ''Is it important for you to learn new things in mathematics?…”

Characterizing Score Reliability for the South Oaks Gambling Screen

“…Reliability coef ficients are used äs the dependent variable(s) in the analysis; coded data of the collected studies are employed as the independent variables. As such, researchers are able to examine potential sources of measurement error and determine which variables to control in subsequent research (Ross, Blackburn & Forbes, 2005).…”