Multimedia Item Type Design for Assessing Human Cognitive Skills

Cheng, Irene; Bischof, Walter F.

doi:10.1109/icme.2007.4285029

Cited by 4 publications

(3 citation statements)

References 11 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Cheng and Bischof [18] have conducted their study "Multimedia Item Type Design for Assessing Human Cognitive Skills" with the incorporation of Intelligent Item Types(IIT). The study has strengthened substances of interactive multimedia items by designing various templates to evaluate student's multiple intelligences.…”

Section: A Theory Of Interactive Multimediamentioning

confidence: 99%

Notice of Retraction: The Study of Suitable Operational Item Template Based on Bloom's Taxonomy

Koong

Chiu

2010

2010 Second International Conference on Computer Engineering and Applications

View full text Add to dashboard Cite

Item templates do not solely confined to conventional true & false, multiple choice, completion item and short answer but also includes those of operational ones, for example, link, match, classification, and order. Since not all the same template can fit into testing different knowledge types, and different templates also have their limits in assessing different knowledge types, dilemma then often appears during the course of item-editing. This research further clarifies what type of template is appropriate for a certain knowledge type under Bloom's Taxonomy. The results indicate that (1) Link template is applicable for Remembering type of knowledge; (2) Match template is suitable for Understanding and Applying type of knowledge; and (3) Both Link and Match templates can better evaluate knowledge from the Analyzing type of knowledge. The results of this study provide information for teachers as to what interactive multimedia testing template will best achieve the expected assessment effect.Keywords-interactive test item system ; operational item template; on-line assessment, Bloom's Taxonomy; assessment effect; multimedia item

show abstract

Section: A Theory Of Interactive Multimediamentioning

confidence: 99%

Notice of Retraction: The Study of Suitable Operational Item Template Based on Bloom's Taxonomy

Koong

Chiu

2010

2010 Second International Conference on Computer Engineering and Applications

View full text Add to dashboard Cite

show abstract

“…Other examples can be drag‐and‐drop (drag the correct word from a list and drop it into the correct position in a paragraph), or listen and dictate (the student types into a text box what (s)he hears from an audio clip). More detailed discussion on testing multiple intelligences can be found in [CB07].…”

Section: Testing Cognitive Intelligences In Addition To Subject Knmentioning

confidence: 99%

Interactive Graphics for Computer Adaptive Testing

Cheng¹,

Basu²

2009

Computer Graphics Forum

View full text Add to dashboard Cite

Interactive graphics are commonly used in games and have been shown to be successful in attracting the general audience. Instead of computer games, animations, cartoons, and videos being used only for entertainment, there is now an interest in using interactive graphics for 'innovative testing'. Rather than traditional pen-and-paper tests, audio, video and graphics are being conceived as alternative means for more effective testing in the future. In this paper, we review some examples of graphics item types for testing. As well, we outline how games can be used to interactively test concepts; discuss designing chemistry item types with interactive 3D graphics; suggest approaches for automatically adjusting difficulty level in interactive graphics based questions; and propose strategies for giving partial marks for incorrect answers. We study how to test different cognitive skills, such as music, using multimedia interfaces; and also evaluate the effectiveness of our model. Methods for estimating difficulty level of a mathematical item type using Item Response Theory (IRT) and a molecule construction item type using Graph Edit Distance are discussed. Evaluation of the graphics item types through extensive testing on some students is described. We also outline the application of using interactive graphics over cell phones. All of the graphics item types used in this paper are developed by members of our research group.

show abstract

“…The goal of our research is to test the viability of multimedia based assessment of musical rhythm recognition skills, and thus a design of the test items is required. A preliminary template was taken from earlier work [6] and revised to meet the needs of our experiments (see Figure 1). The original template design required the observer to drag five out of seven audio clips from the left panel to the middle panel.…”

Section: Preparation Of Multimedia Test Items and Calibrationmentioning

confidence: 99%

Assessing rhythm recognition skills in a multimedia environment

Cheng

Kerr

Bischof

2008

2008 IEEE International Conference on Multimedia and Expo

Self Cite

View full text Add to dashboard Cite

Multimedia content is an effective tool for enhancing learning and testing, and it is more effective than the traditional paper and pencil presentation format. In order to make educational materials more intuitive, more interactive and more inspiring to students, image, audio, video, graphics, animation and 3D items are widely used in current educational applications. However, they are designed mainly for learning and not for testing. Those designed for testing focus on using simple, text-based formats (e.g. multiplechoice and True/False questions) to assess a student's subject knowledge rather than on evaluating a student's cognitive skills and problem-solving ability. In this paper, we propose an interactive framework that uses an innovative test format enriched with audios and videos, for evaluating a student's skills, in this case musical rhythms recognition skills. Experiments were conducted with human observers and the results verify the feasibility of our approach. The goal of this paper is to advance multimedia research in education by extending its capabilities beyond simple knowledge retention and reproduction, and to model the acquisition of cognitive skills in a dynamic context.

show abstract

Multimedia Item Type Design for Assessing Human Cognitive Skills

Cited by 4 publications

References 11 publications

Notice of Retraction: The Study of Suitable Operational Item Template Based on Bloom's Taxonomy

Notice of Retraction: The Study of Suitable Operational Item Template Based on Bloom's Taxonomy

Interactive Graphics for Computer Adaptive Testing

Assessing rhythm recognition skills in a multimedia environment

Contact Info

Product

Resources

About