Transforming a Competency Model to Parameterised Questions in Assessment

Abstract

Abstract. The problem of comparing and matching different learners' knowledge arises when assessment systems use a one-dimensional numerical value to represent "knowledge level". Such assessment systems may measure inconsistently because they estimate this level differently and inadequately. The multi-dimensional competency model called COMpetence-Based learner knowledge for personalized Assessment (COMBA) is being developed to represent a learner's knowledge in a multi-dimensional vector space. The heart of this model is to treat knowledge, not as possession, but as a contextualized space of capability either actual or potential. The paper discusses a system for automatically generating questions from the COMBA competency model as a "guide-on-the-side". The system's novel design and implementation involves an ontological database that represents the intended learning outcome to be assessed across a number of dimensions, including level of cognitive ability and subject matter. The system generates all the questions that are possible from a given learning outcome, which may then be used to test for understanding, and so could determine the degree to which learners actually acquire the desired knowledge.

Designing XML Schema of a Competence Structure from Course Intended Learning Outcomes

“…The considered model for this research draws on the multi-dimensional competency model (called COMBA) from Sitthisak, Gilbert and Davis [7]. This considers the learners" "learned capability" instead of their "knowledge level".…”

“…Figure 1. COMBA Competency Model [7] The considered COMBA competency model incorporates the intended learning outcome which can be formally described as the composition of capability and subject matter. In addition, there are different levels of proficiency in a given intended learning outcome depending upon the context of their performance.…”

A competence-based system for recommending study materials from the Web (CBSR)

“…The proposed model for this paper draws on the multi-dimensional 'COMBA' competency model from Sitthisak, Gilbert and Davis [17]. This considers the learners' "learned capability" instead of their "knowledge level" and considers competencies and learned capabilities as a multidimensional space [17].…”

Towards a Competence Based System for Recommending Study Materials (CBSR)

“…The proposed model for this paper draws on the multidimensional competency model (called COMBA) from Sitthisak, Gilbert and Davis [4] which considers the learners' "learned capability" instead of their "knowledge level" which is difficult to properly characterize or estimate. The COMBA model consists of three major components: subject matter, capability, and context ( Figure 1).…”

“…Section 2 gives the scope and details focusing on AH and the problems of user modelling. Section 3 introduces the competency model [4] which is used in the proposed system design. Section 4 introduces the system design and the process inside the system.…”