Our study reports on published tools for assessing technical skills for OTL-HNS residents during core procedures conducted in the OR. These assessment tools could facilitate the provision of timely feedback to trainees including specific goals for improvement. However, the paucity of publications suggests little agreement on how to best perform work-based direct-observation assessment for core surgical procedures in OTL-HNS. The sparsity of tools specific to OTL-HNS may become a barrier to a fluid transition to competency-based medical education. Laryngoscope, 128:1571-1575, 2018.

No abstract

Purpose Direct assessment of trainee performance across time is a core tenet of competency-based medical education. Unlike variability of psychomotor skills across levels of expertise, performance variability exhibited by a particular trainee across time remains unexplored. The goal of this study was to document the consistency of individual surgeons’ technical skill performance. Method A secondary analysis of assessment data (collected in 2010–2012, originally published in 2015) generated by a prospective cohort of participants at Montreal Children’s Hospital with differing levels of expertise was conducted in 2017. Trained raters scored blinded recordings of a myringotomy and tube insertion performed 4 times by junior and senior residents and attending surgeons over a 6-month period using a previously reported assessment tool. Descriptive exploratory analyses and univariate comparison of standard deviations (SDs) were conducted to document variability within individuals across time and across training levels. Results Thirty-six assessments from 9 participants were analyzed. The SD of scores for junior residents was highly variable (5.8 out of a scale of 30 compared with 1.8 for both senior residents and attendings [F(2,19) = 5.68, P < 0.05]). For a given individual, the range of scores was twice as large for junior residents than for senior residents and attendings. Conclusions Surgical residents may display highly variable performances across time, and individual variability appears to decrease with increasing expertise. Operative skill variability could be underrepresented in direct observation assessment; emphasis on an adequate amount of repetitive evaluations for junior residents may be needed to support judgments of competence or entrustment.

BackgroundEffective communication has been linked to a reduction in adverse events and improved patient compliance. Currently in Otolaryngology – Head and Neck Surgery (OTL-HNS) residency programs, there is limited explicit teaching of communication skills. Our objective was to implement an educational program on communication skills for residents using multisource assessment in several simulation-based contexts throughout residency.MethodsFor three consecutive years, OTL-HNS residents were recruited to participate in a total of nine simulation-based clinical scenarios in which communication skills could be honed. This educational program was designed to provide instruction and practice of challenging ethics scenarios, with communication efficacy as a secondary goal. To facilitate this goal, a multisource assessment was paired with a debriefing process that involved attending staff, observing and participating residents, standardized patients, and invited content experts.ResultsSeventeen residents completed the curriculum for at least two consecutive years from 2009 to 2011. The internal-consistency reliability of the scenarios ranged from 0.88 to 0.96. The intraclass correlation was 0.19, as expected in this context. There was no statistical difference in the mean ratings of performance across post-graduate year (PGY) level (p = 0.201). Results from the random-intercept regression indicated that, on average, a learner’s mean rating at baseline was 3.6/5 and increased significantly by 0.25 points per year (p < 0.05) as assessed by OTL-HNS staff members and peers. No significant improvement across time was found for ratings by non-medical assessors.ConclusionImplementing an educational program focused on communication skills using a multisource assessment in various contexts has shown to be potentially effective at our institution, and resulted for yearly improvement and consolidation of performance of OTL-HNS residents as judged by faculty and residents. The inclusion of a multisource assessment in the simulation curriculum is key to allow for the representation of different perspectives on communication skills, for both the assessment and the debriefing process. Future studies are needed to explore the possibility of fully integrating this educational program into residence training in order to support deliberate communication skills teaching.

Background Head and neck cutaneous squamous cell carcinoma (HNCSCC) is a non-melanoma skin cancer that is mostly caused by solar ultraviolet radiation exposure. While it usually has an excellent prognosis, a subset of patients (5%) develops nodal metastasis and has poor outcomes. The aim of this study was to systematically review the literature and evaluate the prognostic factors of HNCSCC in order to better understand which patients are the most likely to develop metastatic disease. Methods A comprehensive literature search was performed on PubMed and EMBASE to identify the studies that evaluated the prognostic factors of HNCSCC. Prognostic factors were deemed significant if they had a reported p-value of < 0.05. Proportions of studies that reported a given factor to be statistically significant were calculated for each prognostic factor. Results The search yielded a total of 958 citations. Forty studies, involving a total of 8535 patients, were included in the final analysis. The pre-operative/clinical prognostic factors with the highest proportion of significance were state of immunosuppression (73.3%) and age (53.3%); while post-operative/pathological prognostic factors of importance were number of lymph nodes involved with carcinoma (70.0%), margins involved with carcinoma (66.7%), and tumor depth (50.0%). Conclusion This systematic review is aimed to aid physicians in assessing the prognosis of HNCSCC and identifying the subsets of patients that are most susceptible to metastasis. It also suggests that immunosuppressed patients with a high-risk feature on biopsy, such as invasion beyond subcutaneous fat, could possibly benefit from a sentinel lymph node biopsy. Graphical abstract