A Pragmatic Approach for Evaluating and Accrediting Digital Competence of Digital Profiles: A Case Study of Entrepreneurs and Remote Workers

Abstract

During the last decades, digital competence has become essential at workplace. Nowadays, it is difficult to find a job where no ICT skills are required. At the same time, there is a lack of ecosystems for adult reskilling in digital competence. Moreover, most of them do not use of a common language and terminology, decreasing the possibilities of being used by a wider public. In addition, the assessment of digital competence cannot be done using simple self-assessment tests, but more complex tools such as simulations or other activities based on real scenarios. Considering this, we designed a performance-based evaluation system following a pragmatic approach based on DigComp framework. We carried out a needs analysis based on expert consultation (63 teleworkers and 82 entrepreneurs) to create an assessment syllabus and implement the assessment modules. Then, we conducted an analysis by experts (n = 21) of the relationship between the content of the tests and the construct it was intended to measure. After refinement, the system was piloted by end-users all over Europe (n = 525). Results confirmed that DigComp was the most appropriate reference when considering the transversality of digital competence, providing researchers with well-defined clear criteria. Supplementary Information The online version contains supplementary material available at 10.1007/s10758-021-09516-3.

Design and Validation of a Novel Tool to Assess Citizens’ Netiquette and Information and Data Literacy Using Interactive Simulations

“…Another strength of our study was the methodology followed. The development was carried out in an iterative process, which included two cycles of testing and refinement, validating the content of the construct to be assessed and the design of the items, ensuring that the expected knowledge and skills are covered, the item formats selected are suitable for that aim, the usability of the items/tests is correct, e.g., the simulations include all the actions and different possible paths, and finally, the items are well written and easy to understand, which is a key factor in the development of an item bank of DC [86].…”

“…[83]. Therefore, we defined an initial solution based on key studies identified [24,86,87] and from other key studies identified in the literature review, such as [8,9,11,32]. Once the new design proposition was established, it was necessary to examine and improve it after the testing and analysis [83].…”

Assessment of the digital competencies of university instructors through use of the machine learning method

“…With regard to the former, by obtaining a complete picture of the current digital technologies used by university faculty and students in their courses, universities will have the opportunity to make further recommendations and invest in research topics to address the digital divide. Regarding the latter, the use of digital technologies is inevitable in the era of Industry 4.0, and the digital competency of the future industrial workforce depends on the planned development (Bartolomé et al 2022 ). As a bridge between learning and employment, universities have the opportunity to prepare students for the job market of the future and to contribute to the development of a digital industrial environment when we can effectively understand the digital competencies offered in university courses (e.g., by examining the extent to which the use of digital technologies in curricula in various fields is key to meeting current industry needs).…”

Online Education During the Pandemic: A Systematic Literature Review

“…Faculty members and students can be trained to use online applications interactively and develop a lesson plan with a reduced cognitive load to improve efficiency [40]. [139] suggest that the curriculum be organized so that students take an active role in online education. Besides, they indicate that the university administration should ensure that students' and lecturers' satisfaction in the online education organization is continuously monitored to accumulate statistical data in dynamics.…”