Bridging the gap between uncertainty, confidence and diagnostic accuracy: calibration is key

Zwaan, Laura; Hautz, Wolf E.

doi:10.1136/bmjqs-2018-009078

Cited by 38 publications

(47 citation statements)

References 29 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In other domains of medicine, such as dermatology and radiology where diagnosis depends on a visual analysis, it has been shown that diagnostic uncertainty decreases with experience. [62][63][64][65] Our work con rms that this is also true for Electrocardiography, whether conventional or blended learning strategies are used. However, students who engaged in blended ECG learning activities achieved better diagnostic accuracy for topics for which there was initial diagnostic uncertainty.…”

Section: Discussionsupporting

confidence: 63%

Effectiveness of blended learning versus lectures alone on ECG analysis and interpretation by medical students

Viljoen

Millar

Manning

et al. 2020

Preprint

View full text Add to dashboard Cite

Background Most medical students lack confidence and are unable to accurately interpret ECGs. Thus, better methods of ECG instruction are being sought. Current literature indicates that the use of e-learning for ECG analysis and interpretation skills (ECG competence) is not superior to lecture-based teaching. We aimed to assess whether blended learning (lectures supplemented with the use of a web application) resulted in better acquisition and retention of ECG competence in medical students, compared to conventional teaching (lectures alone). Methods Two cohorts of fourth-year medical students were studied prospectively. The conventional teaching cohort (n=67) attended four hours of interactive lectures, covering the basic principles of Electrocardiography, waveform abnormalities and arrhythmias. In addition to attending the same lectures, the blended learning cohort (n=64) used a web application that facilitated deliberate practice of systematic ECG analysis and interpretation, with immediate feedback. All participants completed three tests: pre-intervention (assessing baseline ECG competence at start of clinical clerkship), immediate post-intervention (assessing acquisition of ECG competence at end of six-week clinical clerkship) and delayed post-intervention (assessing retention of ECG competence six months after clinical clerkship, without any further ECG training). Diagnostic accuracy and uncertainty were assessed in each test. Results The pre-intervention test scores were similar for blended learning and conventional teaching cohorts (mean 31.02±13.19% versus 31.23±11.52% respectively, p=0.917). While all students demonstrated meaningful improvement in ECG competence after teaching, blended learning was associated with significantly better scores, compared to conventional teaching, in immediate (75.27±16.22% vs 50.27±17.1%, p<0.001; Cohen’sd=1.58), and delayed post-intervention tests (57.70±18.54% vs 37.63±16.35%, p<0.001; Cohen’s d=1.25). Although diagnostic uncertainty decreased after ECG training in both cohorts, blended learning was associated with better confidence in ECG analysis and interpretation. Conclusion Blended learning achieved significantly better levels of ECG competence and confidence amongst medical students than conventional ECG teaching did. Although medical students undergo a significant attrition of ECG competence without ongoing training, blended learning also resulted in better retention of ECG competence than conventional teaching. Web applications encouraging a stepwise approach to ECG analysis and enabling deliberate practice with feedback may, therefore, be a useful adjunct to lectures for teaching Electrocardiography.

show abstract

Section: Discussionsupporting

confidence: 63%

Effectiveness of blended learning versus lectures alone on ECG analysis and interpretation by medical students

Viljoen

Millar

Manning

et al. 2020

Preprint

View full text Add to dashboard Cite

show abstract

“…In other domains of Medicine, such as Dermatology and Radiology where diagnosis depends on a visual analysis, it had been shown that diagnostic uncertainty decreases with experience. [50][51][52][53] Our work con rms that this is also true for Electrocardiography, whether conventional or blended learning strategies are used. However, students who engaged in blended ECG learning activities achieved better diagnostic accuracy for topics for which there was initial diagnostic uncertainty.…”

Section: Discussionsupporting

confidence: 63%

Effectiveness of Blended Learning versus Lectures alone on ECG Analysis and Interpretation by Medical Students

Viljoen

Millar

Manning

et al. 2020

Preprint

View full text Add to dashboard Cite

Background Most medical students lack confidence and are unable to accurately interpret ECGs. Better methods of ECG instruction are therefore being sought. Current literature indicates that the use of e-learning for ECG analysis and interpretation skills (ECG competence) is not superior to lecture-based teaching. We aimed to assess whether blended learning (lectures supplemented with the use of a web application) resulted in better acquisition and retention of ECG competence in medical students, than with conventional teaching (lectures alone). Methods Two cohorts of fourth-year medical students were studied prospectively. The conventional teaching cohort (n=67) attended four hours of interactive lectures, covering the basic principles of Electrocardiography, waveform abnormalities and arrhythmias. In addition to attending the same lectures, the blended learning cohort (n=64) used a web application that facilitated deliberate practice of ECG analysis and interpretation, with structured feedback. All participants completed three tests: pre-intervention (assessing baseline ECG competence at start of clinical clerkship), immediately post-intervention (assessing acquisition of ECG competence at end of six-week clinical clerkship) and delayed post-intervention (assessing retention of ECG competence six months after clinical clerkship, without any further ECG training). Diagnostic accuracy and uncertainty were assessed in each test. Results The pre-intervention test scores were similar for blended learning and conventional teaching cohorts (mean 31.02±13.19% versus 31.23±11.52% respectively, p=0.917). While all students demonstrated meaningful improvement in ECG competence after teaching, blended learning was associated with significantly better scores, compared to conventional teaching, in immediate (75.27±16.22% vs 50.27±17.1%, p<0.001; Cohen’s d =1.58), and delayed post-intervention tests (57.70±18.54% vs 37.63±16.35%, p<0.001; Cohen’s d =1.25). Although diagnostic uncertainty decreased after ECG training in both cohorts, blended learning was associated with better confidence in ECG analysis and interpretation. Conclusion Blended learning was superior in teaching ECG analysis and interpretation skills to medical students and achieved better levels of ECG competence and confidence than conventional lectures. Although medical students undergo a significant attrition of ECG competence without ongoing training, blended learning also resulted in better retention of ECG competence than conventional teaching. Web applications enabling deliberate practice with structured feedback may therefore be a useful adjunct to lectures for teaching Electrocardiography.

show abstract

“…In other domains of medicine, such as dermatology and radiology, where diagnosis also depends on a visual analysis, it has been shown that diagnostic uncertainty decreases with experience [63][64][65][66]. Our work confirms that this is true for Electrocardiography as well, whether conventional or blended learning strategies are used.…”

supporting

confidence: 82%

Effectiveness of blended learning versus lectures alone on ECG analysis and interpretation by medical students

et al. 2020

View full text Add to dashboard Cite

Background Most medical students lack confidence and are unable to accurately interpret ECGs. Thus, better methods of ECG instruction are being sought. Current literature indicates that the use of e-learning for ECG analysis and interpretation skills (ECG competence) is not superior to lecture-based teaching. We aimed to assess whether blended learning (lectures supplemented with the use of a web application) resulted in better acquisition and retention of ECG competence in medical students, compared to conventional teaching (lectures alone). Methods Two cohorts of fourth-year medical students were studied prospectively. The conventional teaching cohort (n = 67) attended 4 hours of interactive lectures, covering the basic principles of Electrocardiography, waveform abnormalities and arrhythmias. In addition to attending the same lectures, the blended learning cohort (n = 64) used a web application that facilitated deliberate practice of systematic ECG analysis and interpretation, with immediate feedback. All participants completed three tests: pre-intervention (assessing baseline ECG competence at start of clinical clerkship), immediate post-intervention (assessing acquisition of ECG competence at end of six-week clinical clerkship) and delayed post-intervention (assessing retention of ECG competence 6 months after clinical clerkship, without any further ECG training). Diagnostic accuracy and uncertainty were assessed in each test. Results The pre-intervention test scores were similar for blended learning and conventional teaching cohorts (mean 31.02 ± 13.19% versus 31.23 ± 11.52% respectively, p = 0.917). While all students demonstrated meaningful improvement in ECG competence after teaching, blended learning was associated with significantly better scores, compared to conventional teaching, in immediate (75.27 ± 16.22% vs 50.27 ± 17.10%, p < 0.001; Cohen’s d = 1.58), and delayed post-intervention tests (57.70 ± 18.54% vs 37.63 ± 16.35%, p < 0.001; Cohen’s d = 1.25). Although diagnostic uncertainty decreased after ECG training in both cohorts, blended learning was associated with better confidence in ECG analysis and interpretation. Conclusion Blended learning achieved significantly better levels of ECG competence and confidence amongst medical students than conventional ECG teaching did. Although medical students underwent significant attrition of ECG competence without ongoing training, blended learning also resulted in better retention of ECG competence than conventional teaching. Web applications encouraging a stepwise approach to ECG analysis and enabling deliberate practice with feedback may, therefore, be a useful adjunct to lectures for teaching Electrocardiography.

show abstract

Bridging the gap between uncertainty, confidence and diagnostic accuracy: calibration is key

Cited by 38 publications

References 29 publications

Effectiveness of blended learning versus lectures alone on ECG analysis and interpretation by medical students

Effectiveness of blended learning versus lectures alone on ECG analysis and interpretation by medical students

Effectiveness of Blended Learning versus Lectures alone on ECG Analysis and Interpretation by Medical Students

Effectiveness of blended learning versus lectures alone on ECG analysis and interpretation by medical students

Contact Info

Product

Resources

About