An Instrument Designed for Faculty Supervision Evaluation by Anesthesia Residents and Its Psychometric Properties

Abstract

The nine-item instrument produced valid and reliable measures of faculty supervision. However, a significant amount of halo effect biased such measures. G-studies may help identify the type and magnitude of rater biases affecting resident-generated faculty supervision evaluations, and can be useful for interpreting their results, especially if personnel decisions (e.g., tenure, promotion) rely on such measures.

Content analysis of resident evaluations of faculty anesthesiologists: supervision encompasses some attributes of the professionalism core competency

“…The basis for our hypothesis was that de Oliveira Filho et al labelled their question #4 (Table 1) as a reflection of ''professionalism.'' 17 Our second hypothesis was that professionalism has other attributes not measured by the supervision scale and not reported by our residents (i.e., supervision and professionalism are not equivalent constructs). The basis for our hypothesis was that previous studies have listed words and phrases associated with professionalism but seemingly of different themes (Tables 2-4).…”

“…From July 1, 2013 to the present, our department has utilized the de Oliveira Filho supervision scale 6,[10][11][12][13][14][15][16][17] to assess the quality of clinical supervision provided by our anesthesiologists ( Table 1). The cohort reported herein included all of the residents' evaluations of all faculty anesthesiologists over the 2.5-year period, from the starting A The other three core competencies -practice-based learning and improvement, systems-based practice, medical knowledge -were not included in this article.…”

“…The scale has repeatedly been shown in multiple studies to do so as a unidimensional construct (including assessments by nurse anesthetists). 13,15,17,18 Along with the daily numerical scores of faculty supervision, our residents may also provide a written free-text comment about the faculty anesthesiologist. 18 The supervision scores and comments are the cumulative result of how the anesthesiologists perform in clinical environments (i.e., they reflect in situ performance and improve with feedback).…”

“…18 The supervision scores and comments are the cumulative result of how the anesthesiologists perform in clinical environments (i.e., they reflect in situ performance and improve with feedback). 6,10,17 In the current study, we performed a content analysis of a cohort of our department's residents' written evaluations of faculty anesthesiologists to test two hypotheses. One hypothesis was that the clinical supervision scale includes attributes of professionalism and thus is in part assessing anesthesiologists' professionalism.…”

Process Evaluation of introducing Online Faculty Evaluation by Residents at a Tertiary Care Hospital in Pakistan

“…Literature has shown the predictive validity of evaluations on the future performance of the faculty. 15,16 Residency programs in medical subspecialties are common at both public and private teaching hospitals in Pakistan. Various assessments either structured or unstructured have been formalized to evaluate the knowledge and performance of residents.…”