Development and Rasch analysis of the Assessment of Computer-Related Skills

Abstract

The purpose of this study is to evaluate the internal scale validity, person response validity, and reliability of the newly developed Assessment of Computer-Related Skills (ACRS). Data from 32 healthy adult participants who performed two to three computer tasks were analysed to determine how well the participants fitted the many-faceted Rasch (MFR) model of the ACRS, as well as how well the ACRS skill items and tasks (a) fitted the MFR model of the ACRS, (b) matched the expectations for hierarchical ordering of their difficulties, and (c) differentiated persons into different levels of ability. Results indicated that with three skill items removed, the remaining 34 skill items, 8 computer tasks, and 30 participants demonstrated goodness-of-fit to the MFR model of the ACRS. The skills and tasks appeared to have logical hierarchical ordering and differentiated participants into at least three levels of ability. The findings affirmed the internal scale validity, person response validity and reliability of the ACRS for assessing persons' computer abilities. Future studies using a larger sample that includes individuals with disabilities and with difficulties with computer use are needed to further evaluate the validity and reliability of the ACRS.

Exploring potential in participation mediated by digital technology among older adults

“…Kenneth had more computer experience than Ava, but this task proved to be difficult for them both. Receiving and sending emails requires an email account, but providing precise information such as an email address and password can be more difficult than writing free text (Fischl & Fisher, 2007;Fischl, Hammar, Johansson, & Törnqvist, 2010). Kenneth could not identify where the problem lay in his attempts to enter the password, yet he was aware that some programs require precision entries.…”

Untitled

“…Thus, the items were utilised to examine the practice of product approach among the teachers to teach writing in the classroom from various angles to enhance the reliability of the study. The values of infit and outfit mean square of the study for item reliability was found between 0.97 and 0.98 which was within the acceptable range (Fischl and Fisher, 2007). Rasch Measurement Model also provides person reliability.…”

“…The classroom observations of the teachers" teachings were video-taped. The skill of video-taping is important in order to conduct "observational research" though the researcher can "see" the actions (Fischl and Fisher, 2007). For data collection, an Observation Checklist (OC) was used to collect data from the teachers.…”

“…For data collection, an Observation Checklist (OC) was used to collect data from the teachers. A Rasch Measurement Model was used for validation of the OC (Fischl and Fisher, 2007). The constructs of the checklist were tested using Rasch Model Measurement to confirm the item reliability and person reliability.…”

“…Based on the score and frequency of the usage of the selected strategies, the dominant approach was identified. The approaches were measured based on the item and person reliability (Fischl and Fisher, 2007). In addition, the analysis on dimensionality assured the validity of the items used in the study.…”