Script concordance testing: more cases or more questions?

Gagnon, Robert; Charlin, Bernard; Lambert, Carole; Carrière, Benoit; Vleuten, Cees van der

doi:10.1007/s10459-008-9120-8

Cited by 46 publications

(46 citation statements)

References 6 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…2,6 A 60-to 90-minute examination will produce a Cronbach's alpha of 0.70 to 0.85. 7,25,27,28 There are concerns, however, about inter-panellist errors in SCT; the use of Cronbach's alpha in measuring the reliability of the test where partial credit model of scoring is used, ie multiple options/ responses are awarded either a full or fraction of allocated mark; and case scenarios that could create inconsistencies among items.…”

Section: Reliability and Validity Of Script Concordance Test As An Asmentioning

confidence: 99%

Using the script concordance test to assess clinical reasoning skills in undergraduate and postgraduate medicine

Wan

2015

Hong Kong Med J

View full text Add to dashboard Cite

A B S T R A C TThe script concordance test is a relatively new format of written assessment that is used to assess higherorder clinical reasoning and data interpretation skills in medicine. Candidates are presented with a clinical scenario, followed by the reveal of a new piece of information. The candidates are then asked to assess whether this additional information increases or decreases the probability or likelihood of a particular diagnostic, investigative, or management decision. To score these questions, the candidate's decision in each question is compared with that of a reference panel of expert clinicians. This review focuses on the development of quality script concordance Using the script concordance test to assess clinical reasoning skills in undergraduate and postgraduate medicine

show abstract

Section: Reliability and Validity Of Script Concordance Test As An Asmentioning

confidence: 99%

Using the script concordance test to assess clinical reasoning skills in undergraduate and postgraduate medicine

Wan

2015

Hong Kong Med J

View full text Add to dashboard Cite

show abstract

“…Il consiste à présen-ter aux étudiants une série de situations cliniques authentiques, puis à leur demander de considérer l'effet d'une nouvelle information sur une hypothèse crédible. La situation décrite pose un problème même pour un expert puisqu'il manque un ou plusieurs élé-ments, ou que certaines données sont incomplètes, ambiguës ou difficilement interprétables [12,[24][25][26] . Une échelle de type Likert à cinq niveaux est proposée pour répondre à chaque question.…”

Section: L'évaluation Du Raisonnement Cliniqueunclassified

Le potentiel diagnostique des questions d’un test de concordance de scripts pour évaluer le raisonnement clinique infirmier

2015

View full text Add to dashboard Cite

Manuscrit reçu le 20 septembre 2014 ; commentaires éditoriaux formulés aux auteurs le 23 mai et le 6 juin 2015 ; accepté pour publication le 8 juin 2015Résumé -Contexte : Pour guider les programmes de formation, il est nécessaire de pouvoir poser une évaluation diagnostique du raisonnement clinique des infirmières. Or, les outils disponibles à cet effet présentent des problèmes majeurs. Abstract -Background:The development of training programs requires an evaluation of nurses' clinical reasoning. However, there are issues with the evaluation, which uses existing tools. The script concordance test is a promising and innovative evaluation alternative. Purpose: To explore the possibility of using questions from a script concordance test as an evaluation tool in assessing nursing students' clinical reasoning abilities. Data: Transcripts of interviews with nurses and nursing students (n = 55) from a previous study [1] were used. During the interviews, participants were asked to share their thoughts aloud while taking a script concordance test. Analysis: Transcripts were coded to identify thinking categories and strategies used by participants to answer questions from the script concordance test. Q-matrices were then developed to formalize relationships between thinking categories/strategies and the test questions in each group of participants. Results: Each group used different thinking categories/strategies to answer questions in the script concordance test. These questions could help assess nursing students' strengths and weaknesses as they relate to their development level. The reasoning of nursing experts was so unlike that of students that they could not be used as a benchmark for diagnostic evaluation. Conclusion: Depending on groups student nurses use different thinking categories and strategies, and some SCT questions show a diagnostic potential in evaluating nurses' clinical reasoning per level (1st, 2nd and 3rd year).

show abstract

“…Comme la capacité à résoudre un problème clinique ne prédit pas la capacité à résoudre un autre problème, il a été préférable de générer un nombre plus élevé de problèmes plutôt que d'évaluer en profondeur une même situation clinique [18] . Par ailleurs, Gagnon et al [19] recommandaient de construire de 15 à 25 scénarios suivis de trois à cinq items chacun pour assurer une fidélité élevée. Cette version préliminaire du TCS-DC comportait donc 22 scénarios suivis de quatre items.…”

Section: Construction Et Validation Du Tcs-dcunclassified

Élaboration et validation d’un test de concordance de script pour évaluer le raisonnement clinique des infirmières en contexte de détérioration de la condition clinique

et al. 2014

Self Cite

View full text Add to dashboard Cite

Mots-clés Raisonnement clinique ; évaluation du raisonnement clinique ; expertise infirmière ; test de concordance de script ; détérioration clinique ; étude méthodologique * En accord avec les principes de la rédaction épicène, l'utilisation du genre féminin inclut le masculin en ce qui concerne les participants et les participantes de cette étude. Cela inclut les infirmières et les infirmiers, les étudiants et les étudiantes ainsi que les experts et les expertes. Le terme patient est employé au masculin et englobe les hommes et les femmes, sans préjudice au genre opposé. Method: A SCT with 22 scenarios and 88 items was developed then administered to 47 novice and 21 expert nurses. A Cronbach alpha coefficient was used to assess the internal consistency, a test-retest with 12 participants and temporal stability. Content validity was assessed using content validity index (CVI), discriminant validity, with the study of extreme groups. Results: After optimization, the SCT had 20 scenarios and 68 items. Cronbach's alpha of TCS was 0.76. The study of the temporal stability showed a moderate (r = 0.554; IC at 95% = 0.002, 0.847). The CVI of the SCT relevance and clarity was respectively 0.9952 and 0.9933. Novices' scores were lower than those of experts (p < 0.05). There was a significant positive linear relationship between the scores and clinical expertise (p < 0.05). Its overall appreciation is good. Conclusion: This study made available a standardized SCT to evaluate nurses' clinical reasoning in in-hospital situations of clinical deterioration. RECHERCHE ET PERSPECTIVES

show abstract

Script concordance testing: more cases or more questions?

Cited by 46 publications

References 6 publications

Using the script concordance test to assess clinical reasoning skills in undergraduate and postgraduate medicine

Using the script concordance test to assess clinical reasoning skills in undergraduate and postgraduate medicine

Le potentiel diagnostique des questions d’un test de concordance de scripts pour évaluer le raisonnement clinique infirmier

Élaboration et validation d’un test de concordance de script pour évaluer le raisonnement clinique des infirmières en contexte de détérioration de la condition clinique

Contact Info

Product

Resources

About