Educator's blueprint: A how‐to guide for collecting validity evidence in survey‐ based research

Self Cite

BackgroundThe Accreditation Council for Graduate Medical Education (ACGME) and Residency Review Committee oversee resident physician work hours with additional specifics for U.S. emergency medicine (EM) residency programs. While there are maximum work hours, the regulatory bodies do not describe minimum work hours to achieve competency, leading to variable scheduling practices. This study aimed to understand the current landscape of U.S. EM residency scheduling given the expansion of programs, evolution of policies, and increased emphasis on wellness.MethodsWe conducted a cross‐sectional study to assess current strategies of U.S. EM residency scheduling. The RedCap survey was sent to all ACGME‐accredited EM residency programs across the United States via individualized emails between January 10, 2023, and March 15, 2023. Data were combined using Microsoft Excel.ResultsA total of 138 of 278 (50%) programs responded to the survey. A total of 73.2% of programs were using thirteen 28‐day blocks with the remainder using twelve 1‐month blocks or reported “other” block scheduling. The number of blocks in the ED increases with each postgraduate year (PGY). For PGY‐1 through PGY‐3, the most commonly used shift duration was 9 h. The mean total shifts per ED block and hours worked per ED block are as follows: 19 shifts and 185.1 h (PGY‐1), 18.2 shifts and 173.9 h (PGY‐2), 17.3 shifts and 163.6 h (PGY‐3), and 14.8 shifts and 157.2 h (PGY‐4). Programs provide a median for 4 weeks of vacation per year of residency.ConclusionsGiven the expansion of U.S. EM residency programs, we reevaluated the landscape of resident scheduling. We described scheduling patterns related to night shifts, vacations, requested time off, conference coverage, charting time, and circadian rhythms. Programs should utilize these data as a starting point for setting a clinical experience for their residents.

Section: Methodsmentioning

confidence: 99%

“…We performed a cross‐sectional survey study regarding scheduling practices for EM residents in the United States. Following survey best practices, we began by assembling a group of experts in residency leadership and scheduling to develop content validity 7,8 . We conducted a literature search to identify existing survey tools.…”

Section: Methodsmentioning

confidence: 99%

The current landscape of emergency medicine resident scheduling

Parsons,

Mannix,

Gore

et al. 2024

Self Cite

“…Then, pilot test the tool on a meaningful sample of applications (e.g., 30 applications) with all reviewers. Consider using strategies such as “think‐aloud” or cognitive interviewing to solicit understanding of how reviewers interpret the questions 21 . Use this process to develop and refine your initial system and then solicit continued feedback throughout the process.…”

Section: Ten Strategiesmentioning

confidence: 99%

“…Prior to full deployment, it is helpful to pilot the tool with a meaningful sample of files to assess response process validity (i.e., the tool is being interpreted as intended) and ease of use in a range of different circumstances. 21 Begin by reviewing the tool as a small group to ensure all questions are clearly written with appropriate rating options and anchors. 22 Then, pilot test the tool on a meaningful sample of applications (e.g., 30 applications) with all reviewers.…”

Section: Pilot Test the Review Process With A Purposeful Sample Of Ap...mentioning

confidence: 99%

Educator's blueprint: Holistic applicant file review in undergraduate and postgraduate medical education

Shappell,

Carter,

Park

et al. 2023

Self Cite

Medical schools and graduate medical education programs are tasked each year with selecting the next class of trainees, often from large applicant pools with enormous quantities of data to be processed. Review of applicant files must therefore be efficient, equitable, and effective in maximizing the likelihood of trainee success and alignment with institutional missions and values. In this article, we discuss 10 strategies to optimize the file review process for trainee selection. Using these strategies, educators can ensure rigorous and accountable file review processes for their training programs.

“…Given the complexity of survey‐based medical education research, our intention with this series was to simplify the process of conducting survey research within academic emergency medicine 1,2 . Our goal was to improve the approach to survey methodology; as such, we sought to develop a series of best practices articles as a guide for medical education researchers.…”

Section: Introductionmentioning

confidence: 99%

Educator's blueprint: A how‐to guide on survey administration

Ogle,

Hill,

Santen

et al. 2023

Self Cite

In this paper, we take the lessons learned from designing a survey and collecting validity evidence and prepare to administer the survey for research. We focus specifically on how researchers can reach individuals in the target population, methods of contact and engagement, evidence‐informed factors that enhance participation, and recommendations for follow‐up with nonrespondents. We also discuss the challenges of survey administration and provide guidance for navigating low response rates. Surveys are a common tool used to evaluate educational initiatives and collect data for all types of research. However, many clinician educators conducting survey‐based evaluation and research may struggle to efficiently administer their survey. As a result, they often struggle to obtain appropriate response rates and thus may have difficulty publishing their survey results. Previous papers in this series focused on the initial steps of survey development and validation, but it is equally important to understand how best to administer your survey to obtain meaningful responses from a representative sample.