A growing body of research illustrates the importance of aligning efforts across the operational continuum to achieve diversity goals. This alignment begins with the institutional mission and the message it conveys about the priorities of the institution to potential applicants, community, staff, and faculty. The traditional themes of education, research, and service dominate most medical school mission statements. The emerging themes of physician maldistribution, overall primary-care physician shortage, diversity, and cost control are cited less frequently. The importance and salience of having administrative leaders with an explicit commitment to workforce and student diversity is a prominent and pivotal factor in the medical literature on the subject. Organizational leadership shapes the general work climate and expectations concerning diversity, recruitment, and retention. Following the Bakke decision, individual medical schools, supported by the Association of American Medical Colleges, worked to expand the frame of reference for evaluating applicants for medical school. These efforts have come together under the rubric of “holistic review”, permitted by the US Supreme Court in 2003. A large diverse-applicant pool is needed to ensure the appropriate candidates can be chosen for the incoming medical school class. Understanding the optimal rationale and components for a successful recruitment program is important. Benchmarking with other schools regionally and nationally will identify what should be the relative size of a pool. Diversity is of compelling interest to us all, and should pervade all aspects of higher education, including admissions, the curriculum, student services and activities, and our faculties. The aim of medical education is to cultivate a workforce with the perspectives, aptitudes, and skills needed to fuel community-responsive health-care institutions. A commitment toward diversity needs to be made.

Competency-based assessment and an emphasis on obtaining higher-level outcomes that reflect physicians’ ability to demonstrate their skills has created a need for more advanced assessment practices. Simulation-based assessments provide medical education planners with tools to better evaluate the 6 Accreditation Council for Graduate Medical Education (ACGME) and American Board of Medical Specialties (ABMS) core competencies by affording physicians opportunities to demonstrate their skills within a standardized and replicable testing environment, thus filling a gap in the current state of assessment for regulating the practice of medicine. Observational performance assessments derived from simulated clinical tasks and scenarios enable stronger inferences about the skill level a physician may possess, but also introduce the potential of rater errors into the assessment process. This article reviews the use of simulation-based assessments for certification, credentialing, initial licensure, and relicensing decisions and describes rater training strategies that may be used to reduce rater errors, increase rating accuracy, and enhance the validity of simulation-based observational performance assessments.

IntroductionThe purpose of this study is to describe an approach for evaluating assessments used in the first 2 years of medical school and report the results of applying this method to current first and second year medical student examinations.MethodsThree faculty members coded all exam questions administered during the first 2 years of medical school. The reviewers discussed and compared the coded exam questions. During the bi-monthly meetings, all differences in coding were resolved with consensus as the final criterion. We applied Moore's framework to assist the review process and to align it with National Board of Medical Examiners (NBME) standards.ResultsThe first and second year medical school examinations had 0% of competence level questions. The majority, more than 50% of test questions, were at the NBME recall level.ConclusionIt is essential that multiple-choice questions (MCQs) test the attitudes, skills, knowledge, and competency in medical school. Based on our findings, it is evident that our exams need to be improved to better prepare our medical students for successful completion of NBME step exams.