Analysis and Validation of Learning Technology Models, Standards and Specifications

Abstract

The paper presents a model for the analysis, comparison and validation of standards, specifications and in particular reference models in the field of Technology Enhanced Learning (TEL). The Reference Model Analysis Grid (RMAG) establishes categories of reference models and standards. Based on those categories, a set of criteria for the analysis and validation of standards was elaborated as a part of the ICOPER project that aims at interoperable open content for competency-based TEL. The analysis of standards in this context is targeted at developing a set of validated approaches that lead to a new reference model. Four standards were investigated, taking into account a broad range of aspects like practical and semantic interoperability and integration issues. In the case study, the authors analyzed both, the standards and specifications and the usefulness of the RMAG. The results of this case study can be used for further analyses of TEL standards as well as for reference models targeted at interoperability.

A characteristics framework for Semantic Information Systems Standards

“…While the ''Community'' is principally confirmed as a concept in literature on Semantic IS Standardization (Pawlowski and Kozlov 2010;Lampathaki et al 2009), no further specification of the term is given. The expert interview sessions revealed the need for further distinction between target and adopting community.…”

“…Including the ''Business purpose'' as a sub-category in the framework is backed by literature on Semantic IS Standardization (Lampathaki et al 2009;Pawlowski and Kozlov 2010;Mykkanen and Tuomainen 2008). But again the discussion with subject matter experts resulted in the demand for a more detailed elaboration of this category.…”

“…They remain, however, unspecific. And regarding the category ''Implementation'', only Pawlowski and Kozlov (2010) address the point when referring to ''Usage and validation'' (B.9.). The general relevance of ''Reference Implementations'' in IS standardization is supported by the prominent Amaya 8 case, for example.…”

“…The framework proposed by Nelson et al (2005) focuses on standards development organizations. The frameworks proposed by Mykkanen and Tuomainen (2008) and by Pawlowski and Kozlov (2010) are the most detailed approaches. In particular, the Reference Model Analysis Grid by Pawlowski and Kozlov is a methodology for assessing standards, with the broader Little research has been done so far on actually comparing different Semantic IS Standards.…”

“…Evaluation framework (Mykkanen and Tuomainen 2008) B. Reference model analysis grid (RMAG) (Pawlowski and Kozlov 2010) C. Comparative analysis (Nelson et al 2005) D. Evaluation taxonomy (Lampathaki et al 2009 (Baskerville 1997) and involved two researchers. The researchers had an active role in the case and closely collaborated with the principal at the ministry.…”