The relative effectiveness of three occupational analysis methods

Abstract

In invesu'gating the eommanieation competencies needed in the workplace by automo~hce meelumies apprentices in their final years and tradespersons (first year), an attempt was made to determine the comparative effectiveness of three occupational analysis techniques: DACUM (involving supervisors); 0~ ; and ~d l~,nmtion ,f~rck (Information Search used to develop a draft list of competencies, to which were added additional competencies suggested by auto mechanics, teachers of auto mechanics, and teachers of communications). With respect to the Phase 2 (list of competeneies after Hermarm, 1987) data, the Extended Information Search was found to produce a comprehensive valid list. The DACUM method produced comprehensive data, but diffwulty was experienced in obtaining suffwient participants to undertake this method. The Observation method took about the same time and produced the least comprehensive data. For Phase 3 (data on each competency), the completion (in class and via mailing) of the competencies inventory was the most effective technique, due to the large and mare representative sample.

Which occupational analysis technique: Critical incident, DACUM, and/or information search?

“…This study confirms the findings of Rayner and Hermann (1988) that DACUM and Information Search (or Extended Information Search) are very useful OA techniques for determining the Phase 2 list of competencies presently performed: both for the more routine (but still very important) competencies, and for the more 'refractory' (harder to detect) competencies. In this Study, these two techniques were overall found to be equally effective, based on measures of comprehensiveness and uniqueness.…”

“…Based on this study, the Rayner and Hermann (1988) study, and another study presently underway, no single OA technique has been found to contribute 80~ or more of the competencies found by three OA techniques. It is recommended that for any major occupational analysis, at least two OA techniques be used.…”

“…Until Rayner and Hermann (1988), there have been virtually no published empirical data on the relative effectiveness of OA techniques when used for curriculum development purposes.…”

“…The wisdom of relying on such data alone has been severely criticized, because of the possible limited experience across firms, the lack of recency as a job incumbent in the occupational area due to promotion, and the ideological blinkers, of such personnel (e.g. Rayner and Hermann, 1988).…”