Interrater Reliability of the Motivation Assessment Scale: Another, Closer Look

Abstract

Recent evidence indicates that the Motivation Assessment Scale (MAS), designed by Durand and Crimmins (1988) to measure influential maintaining variables of maladaptive behavior, is associated with inadequate interrater reliability. In this study, interrater reliability of the MAS was reinvestigated utilizing direct-care staff members familiar with persons with mental retardation. Problematic overt behaviors were evaluated in 42 adults in southern Nevada. MAS items were found to be reliable moderately but significantly across raters. Variables that affect reliability, including low or high behavior frequency, differential training procedures for raters, and setting selection should be considered closely by MAS administrators.

Intrinsic and Extrinsic Motivation for Stereotypic and Repetitive Behavior

“…Shogren and Rojahn (2003) reported that overall retest reliability was good to excellent across subscales (range .71-.89), which was slightly lower than correlations reported by Durand and Crimmins (1988); their range was .92-.98). Evidence for acceptable interrater and retest reliability has been found in studies where the maladaptive behaviors were clearly defined and more frequent (Barton-Arwood et al 2003;Kearney 1994). In contrast, earlier researchers who adhered to less strict administration criteria also failed to establish good evidence for MAS reliability.…”

Psychometric comparison of theMotivationAssessmentScale (MAS) and theQuestionsAboutBehavioralFunction (QABF)

“…), the frequency of behaviours (Sigafoos et al . ), support worker training and qualifications (Kearney ), and whether support workers completed the questionnaires on their own or via interview (Paclawskyj et al . ).…”

“…Most of this research has focused on the inter-rater reliability of the MAS, with frequent reports of lower, and often unacceptable, levels than reported by Durand & Crimmins (1988) (e.g. Crawford et al 1992Kearney 1994;Sigafoos et al 1994). Particular concerns about the MAS have been findings of poor item-by-item agreement and, to a lesser degree, agreement in sub-scale scores.…”

Are caregivers’ reports of motivation valid? Reliability and validity of the Reiss Profile MR/DD

“…sexuality or independence). As Kearney (1994) suggested, the evaluation of low frequency behaviours may be based more on intuition and result in discrepant guesses.…”