Development and psychometric testing of Reasoning Skills test for nursing student selection: An item response theory approach

Abstract

Aims To develop and psychometrically test the Reasoning Skills (ReSki) test assessing undergraduate nursing applicants' reasoning skills for student selection purposes. Design A methodological cross‐sectional design was applied for the psychometric testing. Methods The ReSki test was developed as part of a wider electronic entrance examination. The ReSki test included a case followed by three question sections assessing nursing applicants' reasoning skills according to the reasoning process. Item response theory was used for psychometric testing to assess item discrimination, difficulty and pseudoguessing parameters. The ReSki test was taken by 1056 nursing applicants in six Finnish Universities of Applied Sciences (28 May 2019). Results In the development process, the expert evaluations indicated acceptable content validity. In the psychometric testing, the test reliability was supported by item variance, the theoretical structure was supported by the correlation coefficients and the applicant mean performance supported an acceptable overall test difficulty. The item response theory indicated variance between the items’ difficulty and discrimination ranges. However, most of the wrong items failed at being functional distractors. Conclusion The ReSki test is a new and valid objective assessment of undergraduate nursing applicants' reasoning skills. The item response theory provided item‐level information that can be used for further development of the test, especially related to the revisions needed for the distractor items to achieve the desired level of difficulty. Impact What problem did the study address? The assessment of nursing applicants' reasoning skills is suggested, but there is a lack of admission tools. What were the main findings? The results provided support for the reliability and validity of the ReSki test. Item response theory indicated the need for further item‐level improvement. Where and on whom will the research have an impact? The results may benefit higher education institutions and researchers when developing a test and/or student selection processes.

Development and psychometric evaluation of the Emotional Intelligence Test (EMI‐T) for social care and healthcare student selection

“…IRT is a scarcely applied method in nursing education research (Tavakol et al, 2014 ). To the best of our knowledge, only one previous study in the field of nursing science has used IRT with TestGardener software (Vierula, Talman, et al, 2021 ).…”

“…The graphical analysis of ICCs enables a full distractor analysis, in which the curves of all response options can be studied. IRT distractor analysis evaluates whether distractors function properly and are unambiguous (Figure 1 ; Gierl et al, 2017 ; Tavakol et al, 2014 ; Vierula, Talman, et al, 2021 ).…”

Il ragionamento clinico degli studenti infermieri: uno studio osservazionale

“…La Tabella 3 mostra che l'età sembra non influenzare in alcun modo lo sviluppo del ragionamento clinico degli studenti, così come la regolarità della frequenza universitaria, l'istituto superiore di provenienza, la soddisfazione degli studenti, lo svolgimento di attività tutoriali in previsione del tirocinio clinico, e la media curricolare dei voti ottenuta nel triennio. L'anno di corso, invece (p<0,001), la motivazione dello studente (p=0,04), il numero di ore di tirocinio svolte (8,20).…”

“…Le variabili risultate, invece, indipendenti dalle abilità di ragionamento clinico sono state: l'età, la regolarità della frequenza, l'istituto superiore di provenienza, la soddisfazione nei confronti del percorso di Laurea, il rapporto numerico esistente tra studente e assistente di tirocinio durante le esperienze professionalizzanti. La letteratura preesistente sottolinea che l'età e l'istituto di provenienza sono aspetti correlati alle abilità di ragionamento clinico degli infermieri già laureati (20).…”

Improving Students' Reasoning Through the Integration of Lontara Script in the Blended Learning-Mind Mapping Method

“…Kemampuan penalaran adalah proses berpikir untuk mengidentifikasi masalah dalam menghasilkan pernyataan baru yang akan digunakan selama menyelesaikan masalah proses berpikir dengan menghubungkan fakta-fakta atau evidensi-evidensi yang menuju pada suatu kesimpulan (Vierula et al, 2021;Nasuition et al, 2021;Saragih, Adisaputera dan Saragi, 2019;Susanti dan Rustam, 2018;Mustika, Makmun dan Feranie, 2019). Kemampuan penalaran siswa ditandai oleh empat indikator, yaitu kemampuan siswa dalam mengenal pola permasalahan secara sederhana sehingga mampu dipahami, kemampuan siswa untuk membuat perkiraan terkait konsep/materi sebagai argumen dasar yang dapat digunakan dalam menyelesaikan permasalahan, kemampuan siswa untuk menjalankan rencana untuk membuktikan argumen dasar yang telah dibangun, serta kemampuan siswa untuk menyatakan argumennya setelah melakukan pembuktian terhadap argumen dasar yang dibangun (Syahlan, Malay and Matondang, 2022).…”