Evaluation of the Psychometric Properties of the Arab Compulsive Internet Use Scale (CIUS) by Item Response Theory Modeling (IRT)

Abstract

Introduction: The psychometric properties of the Arab translation of the Compulsive Internet Use Scale (CIUS) have been previously studied by confirmatory factor analysis (CFA) with AMOS software using the asymptotically distribution-free (ADF) estimator. Unidimensionality has been achieved at the cost of correlating several item variance errors. However, several reviews of SEM software packages and estimation methods indicate that the option of robust standard errors is not present in the AMOS package and that ADF estimation may yield biased parameter estimates. We therefore explored a second analysis through item response theory (IRT) using the parametric graded response model (GRM) and the marginal maximum likelihood (MML) estimation method embedded in the LTM package of R software. Differential item functioning (DIF) or item bias across subpopulations was also explored within IRT framework as different samples were investigated. The objective of the current study is to (1) analyze the Arab CIUS scale with IRT, (2) investigate DIF in three samples, and (3) contribute to the ongoing debate on Internet-use-related addictive behaviors using the CIUS items as a proxy. Methods: We assessed three samples of people, one in Algeria and two in Lebanon, with a total of 1520 participants. Results: Almost three out of every five items were highly related to the latent construct. However, the unidimensionality hypothesis was not supported. Furthermore, besides being locally dependent, the scale may be weakened by DIF across geographic regions. Some of the CIUS items related to increasing priority, impaired control, continued use despite harm, and functional impairment as well as withdrawal and coping showed good discriminative capabilities. Those items were endorsed more frequently than other CIUS items in people with higher levels of addictive Internet use. Conclusions: Contrary to earlier ADF estimation findings, unidimensionality of the CIUS scale was not supported by IRT parametric GRM in a large sample of Arab speaking participants. The results may be helpful for scale revision. By proxy, the study contributes to testing the validity of addiction criteria applied to Internet use related-addictive behaviors.

Psychological characteristics of young men with Internet addiction: A cross-cultural study

“…This confirms the existence of a connection between Internet addiction and depression, which can manifest itself as bad mood, pessimism, slow thinking, reduced volition, etc. These findings are consistent with the results of modern research that address the significant role of depression in the development of Internet addiction (Kim et al, 2006;Morrison & Gore, 2010;Khazaal et al, 2022).…”

Modeling of the Chinese Dating App Use Motivation Scale According to Item Response Theory and Classical Test Theory

“…For polytomous categorical responses, Masters’ partial credit model (PCM) and variants or Samejima’s graded response IRT model (GRM) were used. In comparison to PCM, the GRM fit the data reasonably well in most studies [ 19 , 20 , 21 ]. As the most commonly used model, GRM is a modern measurement method that overcomes some limitations of classical test theory methods [ 22 ], and was used for estimating item parameters in our study.…”

Validation of the Chinese version of the Oslo-3 Social Support Scale among nursing students: a study based on Classical Test Theory and Item Response Theory models

“…The discrimination parameters (α) and difficulty parameters (β) were calculated for every single item. The α value falls within the range of 1.35 to 1.69, indicating extremely high, and above 1.70, indicating very high [ 52 ]. According to the difficulty criterion, values should exhibit a monotonic increase [ 53 , 54 ].…”