Impact du panel de référence sur les qualités psychométriques d’un test de concordance de script développé en formation initiale des sages-femmes

Gantelet, Madeleine; Demeester, Anne; Pauly, Vanessa; Gagnon, Robert; Charlin, Bernard

doi:10.1051/pmed/2013047

Cited by 1 publication

(4 citation statements)

References 15 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Four studies compared panels with different types of expertise 21,57–59 . Two studies looked at differences in terms of level of specialisation.…”

Section: Resultsmentioning

confidence: 99%

“…Two studies looked at differences in terms of level of specialisation. One study in midwifery compared results based on a panel with general expertise in midwifery with results based on a panel with specialised expertise in the various domains tested 21 . Neither examinee scores nor the psychometric qualities of individual items differed significantly.…”

Section: Resultsmentioning

confidence: 99%

“…The search yielded 82 relevant references (Fig. S1, online), of which 50 were articles, 27 were conference abstracts, and five were dissertations 18,21–66 . (A full list is available in Appendix S1.…”

Section: Resultsmentioning

confidence: 99%

“…Co‐authors provided three additional references for two dissertations 21,22 and one article that was then in press 23 …”

Section: Methodsmentioning

confidence: 99%

See 3 more Smart Citations

How to construct and implement script concordance tests: insights from a systematic review

et al. 2012

Self Cite

View full text Add to dashboard Cite

CONTEXT Programmes of assessment should measure the various components of clinical competence. Clinical reasoning has been traditionally assessed using written tests and performance-based tests. The script concordance test (SCT) was developed to assess clinical data interpretation skills. A recent review of the literature examined the validity argument concerning the SCT. Our aim was to provide potential users with evidence-based recommendations on how to construct and implement an SCT. RESULTS The search yielded 848 references, of which 80 were analysed. Studies suggest that tests with around 100 items (25-30 cases), of which 25% are discarded after item analysis, should provide reliable scores. Panels with 10-20 members are needed to reach adequate precision in terms of estimated reliability. Panellists' responses can be analysed by checking for moderate variability among responses. Studies of alternative scoring methods are inconclusive, but the traditional scoring method is satisfactory. There is little evidence on how best to determine a pass ⁄ fail threshold for high-stakes examinations. METHODSCONCLUSIONS Our literature search was broad and included references from medical education journals not indexed in the usual databases, conference abstracts and dissertations. There is good evidence on how to construct and implement an SCT for formative purposes or medium-stakes course evaluations. Further avenues for research include examining the impact of various aspects of SCT construction and implementation on issues such as educational impact, correlations with other assessments, and validity of pass ⁄ fail decisions, particularly for high-stakes examinations.

show abstract

“…Four studies compared panels with different types of expertise 21,57–59 . Two studies looked at differences in terms of level of specialisation.…”

Section: Resultsmentioning

confidence: 99%

Section: Resultsmentioning

confidence: 99%

Section: Resultsmentioning

confidence: 99%

“…Co‐authors provided three additional references for two dissertations 21,22 and one article that was then in press 23 …”

Section: Methodsmentioning

confidence: 99%

See 2 more Smart Citations

How to construct and implement script concordance tests: insights from a systematic review

et al. 2012

Self Cite

View full text Add to dashboard Cite

show abstract

Impact du panel de référence sur les qualités psychométriques d’un test de concordance de script développé en formation initiale des sages-femmes

Cited by 1 publication

References 15 publications

How to construct and implement script concordance tests: insights from a systematic review

How to construct and implement script concordance tests: insights from a systematic review

Contact Info

Product

Resources

About