Identifying the accuracy of and exaggeration in self-reports of ICT knowledge among different groups of students: The use of the overclaiming technique

Voňková, Hana; Papajoanu, Ondrej; Štípek, Jiří; Králová, Kateřina

doi:10.1016/j.compedu.2020.104112

Cited by 8 publications

(14 citation statements)

References 30 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…However, this difference was no longer significant when controlling for C/IER. This result points to an important alternative explanation of gender differences in overclaiming and similar biases (Vonkova et al, 2021). Traditionally, social desirability, importance, and gender-related stereotypes of the studied domain were seen as factors explaining the precision of self-assessment in sociodemographic groups (e.g., Palczyńska & Rynko, 2020) Our results point out that any sociodemographic differences, such as more overclaiming in male participants, should be first controlled for methodological factors, such as C/IER, before a search is made for substantial (socio-psychological) explanations.…”

Section: Discussionmentioning

confidence: 73%

“…In general, a number of studies employing ICT skills self-assessment in student samples reported significant overestimations in various samples (Grant et al, 2009;Maderick et al, 2016;McCourt Larres et al, 2003;Merritt et al, 2005;Vonkova et al, 2021; see also Mabe & West, 1982;Zell & Krizan, 2014).…”

Section: Literature Review: the Positivity Bias Problem In Digital Co...mentioning

confidence: 99%

“…The literature on information and communications technology (ICT) skills self-assessment shows that this domain is not free of these problems either (e.g., Litt, 2013;Palczyńska & Rynko, 2020;Vonkova et al, 2021) and that respondents are likely to yield biased responses, that is, they indicate what they think they should know (social desirability bias) or what they think they know rather than what they actually do know (positivity bias). Overall, there is evidence that approximately 30% of participants overestimate their performance and 10% to 15% underestimate it (John & Robins, 1994;Randall & Fernandes, 1991;Robins & Beer, 2001).…”

mentioning

confidence: 99%

See 2 more Smart Citations

Can Overclaiming Technique Improve Self-Assessment Tools for Digital Competence? The Case of DigCompSat

Muszyński

Pokropek

Castaño-Muñoz

et al. 2022

Social Science Computer Review

View full text Add to dashboard Cite

Digital competence is crucial for living, working and participating in current societies. Despite its huge importance, objective measurement tools for it are scarce due to its developmental difficulty. Self-assessment of digital competence seems a promising proxy of objective tests, and it additionally offers the possibility for surveying otherwise unmeasurable constructs such as attitudes and beliefs. However, self-assessment tools are burdened with validity problems, most notably response biases such as overly positive descriptions, overclaiming or careless and insufficient effort responding. In this paper, we investigate how these problems can be mitigated by using the overclaiming technique, a technique that identifies and corrects the bias variance in self-assessments. Our main result was that the use of the overclaiming technique can lead to higher reliability and validity of digital competence self-assessment tools, especially for short scales. Moreover, it allows for correcting additional spurious variance in comparison with careless responding indexes, which allows the use of both these techniques in parallel to increase the quality of data. Our results are important in providing advances in enhanced information on digital competence that can result in better lifelong learning decisions when used at the individual level and in better policy-making decisions when used at the aggregate level.

show abstract

Section: Discussionmentioning

confidence: 73%

Section: Literature Review: the Positivity Bias Problem In Digital Co...mentioning

confidence: 99%

mentioning

confidence: 99%

See 1 more Smart Citation

Can Overclaiming Technique Improve Self-Assessment Tools for Digital Competence? The Case of DigCompSat

Muszyński

Pokropek

Castaño-Muñoz

et al. 2022

Social Science Computer Review

View full text Add to dashboard Cite

show abstract

“…Inaccuracies in the assessment of one's own knowledge in the field of ICT can negatively affect the use of this knowledge in the learning process. The researchers suggest using more accurate methods of assessing their own knowledge (Vonkova et al, 2021;Webb et al, 2018).…”

Section: Discussionmentioning

confidence: 99%

Formation and Development of Digital Literacy of the Population Based on Visualization Technologies

2021

International Journal of Media and Information Literacy

View full text Add to dashboard Cite

This study examines the formation and development of information literacy skills of the population in the context of the penetration of information and communication technologies in all spheres of activity and the formation of a global digital space. The analysis of the scientific literature showed a significant interest of scientists in the category of information literacy of various population groups. Based on the analysis, it was revealed that most attention is paid to the development of information literacy among young people. Schools, colleges and universities successfully teach young people modern technologies. As a result of the study, it was revealed that there are practically no training programs aimed at middle-aged people, although they are the active users of information technologies both in everyday life and in professional activities. Based on the results of the review, the study of modern visual techniques for the development of digital skills and methods for evaluating the effectiveness of such training in different conditions can be proposed for subsequent research. In the course of the survey of respondents, three groups of people were identified, to varying degrees focused on the digital environment. The results show that Respondents who are highly focused on the digital environment most often use it in a functional version: they use it exclusively for paying bills, receiving services from the state. Those who are on average focused on the digital environment, most often try to self-actualize in it, to find conditions for self-development. They have the most constructive and creative attitude to the possibility of using it. Based on the results of the study, recommendations were proposed for training centers on the use of visualization technologies, which will help significantly improve the efficiency and quality of information literacy development in middle-aged people.

show abstract

“…Ten by se mohl též více zaměřit na využití metody při analýze vztahů mezi sebehodnocením a studijními výsledky žáků uvnitř jednotlivých zemí. Metoda již například ukázala potenciál zvýšit korelaci mezi hodnocením obeznámenosti s ICT položkami a výsledkem v ICT testu u českých žáků studujících na různých typech středních škol (Vonkova et al, 2021). Zatímco v šetření PISA 2012 byla MINa aplikována pouze v oblasti matematiky (hlavní oblast, na kterou se šetření v tomto roce zaměřovalo), do budoucna by se nabízelo toto pokrytí rozšířit a zahrnout MINa položky z více oblastí podobně, jako je tomu v rámci dotazníku OCQ (Paulhus et al, 2003).…”

Section: Mina V Kontextu Studia Nerovností Mezi žáKyunclassified

The Overclaiming Technique in the Pisa Study: A Review Study

Papajoanu¹,

Voňková²

2022

View full text Add to dashboard Cite

The overclaiming technique (OCT) is frequently used in research. It is based on analysis of reported familiarity with existing and non-existing items. The inclusion of the OCT in PISA is important for educational research. The aim of this article is to thematically categorize studies using PISA 2012 OCT data, which has not been done before. We identified five thematic categories: mathematics education, questionnaire surveys responding, dishonest behavior, (over)confidence, and inequalities between students. In future, the technique can be used in the context of school misbehavior research.

show abstract

Identifying the accuracy of and exaggeration in self-reports of ICT knowledge among different groups of students: The use of the overclaiming technique

Cited by 8 publications

References 30 publications

Can Overclaiming Technique Improve Self-Assessment Tools for Digital Competence? The Case of DigCompSat

Can Overclaiming Technique Improve Self-Assessment Tools for Digital Competence? The Case of DigCompSat

Formation and Development of Digital Literacy of the Population Based on Visualization Technologies

The Overclaiming Technique in the Pisa Study: A Review Study

Contact Info

Product

Resources

About