Test de concordance de script :
un nouveau mode d’établissement des scores
limitant l’effet du hasard

Vanbelle, Sophie; Massart, Valérie; Giet, Didier; Albert, Adelin

doi:10.1051/pmed:2007002

Cited by 6 publications

(10 citation statements)

References 8 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…One study used a scoring method akin to using kappa coefficients to correct scores for chance agreement. A comparison of this method with the traditional method did not indicate better reliability in either (both were very poor) 63 . A similar scoring method was used in another study in which it demonstrated good discriminative ability (but was not compared with the traditional method) 46 .…”

Section: Resultsmentioning

confidence: 87%

How to construct and implement script concordance tests: insights from a systematic review

et al. 2012

View full text Add to dashboard Cite

CONTEXT Programmes of assessment should measure the various components of clinical competence. Clinical reasoning has been traditionally assessed using written tests and performance-based tests. The script concordance test (SCT) was developed to assess clinical data interpretation skills. A recent review of the literature examined the validity argument concerning the SCT. Our aim was to provide potential users with evidence-based recommendations on how to construct and implement an SCT. RESULTS The search yielded 848 references, of which 80 were analysed. Studies suggest that tests with around 100 items (25-30 cases), of which 25% are discarded after item analysis, should provide reliable scores. Panels with 10-20 members are needed to reach adequate precision in terms of estimated reliability. Panellists' responses can be analysed by checking for moderate variability among responses. Studies of alternative scoring methods are inconclusive, but the traditional scoring method is satisfactory. There is little evidence on how best to determine a pass ⁄ fail threshold for high-stakes examinations. METHODSCONCLUSIONS Our literature search was broad and included references from medical education journals not indexed in the usual databases, conference abstracts and dissertations. There is good evidence on how to construct and implement an SCT for formative purposes or medium-stakes course evaluations. Further avenues for research include examining the impact of various aspects of SCT construction and implementation on issues such as educational impact, correlations with other assessments, and validity of pass ⁄ fail decisions, particularly for high-stakes examinations.

show abstract

Section: Resultsmentioning

confidence: 87%

How to construct and implement script concordance tests: insights from a systematic review

et al. 2012

View full text Add to dashboard Cite

show abstract

“…Cette grille peut être optimisée selon différentes méthodes décrites plus loin et proposées dans la littérature [12,20] .…”

Section: Question 1 Quels Sont Les Principes Du Test De Concordance Dunclassified

“…Dans le cadre d'un TCS en médecine générale, Vanbelle [12] a calculé les scores qu'obtiendrait un étu-diant s'il choisissait systématiquement un échelon de l'échelle. À titre d'exemple, si un étudiant répond systématiquement -2, -1, 0, +1 ou +2, Vanbelle [12] a calculé qu'il récolterait respectivement 0,28 ; 0,40 ; 0,64 ; 0,43 ou 0,14 point. Cet étudiant qui répondrait au hasard (c'est-à-dire qu'il a une chance sur cinq de choisir chaque niveau de l'échelle de Likert), obtiendrait un score de 0,38 point (soit 38 %).…”

Section: Question 12unclassified

See 1 more Smart Citation

Le test de concordance de script en 20 questions

et al. 2013

Self Cite

View full text Add to dashboard Cite

Résumé -Objectif : Le présent article se donne comme objectif de répondre, en 20 questionsréponses, aux principales préoccupations que les équipes d'enseignants potentiellement intéressées par le test de concordance de script (TCS) peuvent se poser. Les questions et objections souvent rapportées par les étudiants sont également prises en compte. Exégèse : Les principes qui sous-tendent le TCS sont rappelés. Ses atouts et ses limites sont évoqués. Les étapes de construction, de validation, de passation, de calcul de la note sont développées. Les auteurs illustrent le propos en s'appuyant sur une expérience concrète menée au Département de médecine générale de l'Université de Liège. Abstract -Objective:Most teacher concerns about Script Concordance Tests (SCT) are the object of some 20 questions and answers. The questions and objections most commonly reported by students are also taken into account. Analysis: The principles of SCT are described. Their strengths and limitations are discussed. The steps in designing, validating, testing and calculating scores are developed. The authors depict the concepts based an experiment led in the

show abstract

“…The problem is to evaluate the agreement between each individual medical student and the panel of experts. Between 2003 and 2005, an SCT was proposed to students training in general practice (Vanbelle et al, 2007). The SCT consisted of 34 items relating possible situations encountered in general practice.…”

Section: Script Test Of Concordancementioning

confidence: 99%