Growing interest in learning objects (LOs) as a means of developing learning materials is leading to mainline LO evaluation methodologies using review instruments, such as evaluation rubrics, to suit various practical purposes. Such evaluation tools give evidence about the design and the value of the LOs, and studies performed with actual users can provide data against which these expectations of the effects of LOs on student achievements in practice can be set. This study presents a validation of a learning object review instrument (LORI) with student users (n=507) of twenty-four LOs used in K-12 environments. T he data collected through pre-and post-tests, teachers' and students' usability questionnaires, and the LORI revealed some interactions between those variables. However, the LORI ratings, and the usability assessments did not correlate with the learning gains of students. Some implications of these findings are discussed.Keywords: Learning objects, learning outcome, LORI, validation.
IntroductionTo meet diverse learning needs and to improve student learning, a variety of resources, often including digital media, are developed where the combination of the media and methods of use change with context and try to take account of student differences. New technologies have emerged to assist these objectives, and one method of designing and presenting computer based educational materials is that of learning objects (LOs), usually defined as any digital resource that can be reused to support learning (Wiley, 2000). Examples of such digital resources that can be employed within instructional materials include images or photos, live data feeds, live or prerecorded video or audio snippets, text, animations, and web-delivered applications such as a Java applet, a blog, or a web page combining text, images and other media. Thus LO approaches can be wide-ranging and offer new possibilities to access and reuse online materials (Wiley, 2005).Online repositories storing large numbers of LOs, which different user groups (e.g. teachers, instructional designers, material producers, and learners) can access and employ in various contexts according to their needs, can, in principle, bring economy and variety into the educational process (Nurmi & Jaakkola, 2006a). However, although LOs can provide stimulating opportunities to improve educational practices, to extendMaterial published as part of this publication, either on-line or in print, is copyrighted by the Informing Science Institute. P ermission to make digital or paper copy of part or all of these works for personal or classroom use is granted without fee provided that the copies are not made or distributed for profit or commercial advantage AND that copies 1) bear this notice in full and 2) give the full citation on the first page. It is permissible to abstract these works so long as credit is given. To copy in all other cases or to republish or to post on a server or to redistribute to lists requires specific permission and payment of a fee. Contact 0HPublish...