Design and Validation of a Novel Tool to Assess Citizens’ Netiquette and Information and Data Literacy Using Interactive Simulations

Abstract

Until recently, most of the digital literacy frameworks have been based on assessment frameworks used by commercial entities. The release of the DigComp framework has allowed the development of tailored implementations for the evaluation of digital competence. However, the majority of these digital literacy frameworks are based on self-assessments, measuring only low-order cognitive skills. This paper reports on a study to develop and validate an assessment instrument, including interactive simulations to assess citizens’ digital competence. These formats are particularly important for the evaluation of complex cognitive constructs such as digital competence. Additionally, we selected two different approaches for designing the tests based on their scope, at the competence or competence area level. Their overall and dimensional validity and reliability were analysed. We summarise the issues addressed in each phase and key points to consider in new implementations. For both approaches, items present satisfactory difficulty and discrimination indicators. Validity was ensured through expert validation, and the Rasch analysis revealed good EAP/PV reliabilities. Therefore, the tests have sound psychometric properties that make them reliable and valid instruments for measuring digital competence. This paper contributes to an increasing number of tools designed to evaluate digital competence and highlights the necessity of measuring higher-order cognitive skills.

Science Learning in Answering Digital Competency Needs of Preservice Math and Science Teachers in the STEM Context

“…Netiquette refers to the rules and ethics that govern human behavior and interaction in the online world. Netiquette covers various aspects, such as using polite language, respecting the privacy of others, avoiding spamming and trolling, and complying with copyrights and intellectual property rights (Bartolomé & Garaizar, 2022). According to Soler-Costa et al (2021), this netiquette is a fundamental pillar of social interaction in the digital world.…”

Analisa Sosialisasi Netiket dalam Berkomunikasi di Aplikasi Pesan Instan dan Media Sosial

“…Penyuluhan netiket pada sekolah SMK telah dilakukan di agenda Pengabdian kepada Masyarakat di masa lalu [10]. Sangat penting untuk memberdayakan orang dengan kemampuan yang tepat untuk menggunakan teknologi yang sesuai untuk berpartisipasi di kondisi masyarakat saat ini [11]. Hal ini dilakukan dalam upaya meningkatkan literasi berinternet yang baik dan benar dalam membangun iklim budaya yang santun di era transformasi digital [12] di Indonesia.…”

Using ACER ConQuest program to examine multidimensional and many-facet models

“…Besides, the use of the Conquest program is preferred in studies where multidimensional structures are examined or many-facet models are used (Bartolomé & Garaizar, 2022;Mendoza et al, 2022;Wang et al, 2022;Zhai, 2022).…”