Background: With the rapid proliferation of online medical education resources, quality evaluation is increasingly critical. The Medical Education Translational Resources: Impact and Quality (METRIQ) study evaluated the METRIQ-8 quality assessment instrument for blogs and collected feedback to improve it.Methods: As part of the larger METRIQ study, participants rated the quality of five blog posts on clinical emergency medicine topics using the eight-item METRIQ-8 score. Next, participants used a 7-point Likert scale and free-text comments to evaluate the METRIQ-8 score on ease of use, clarity of items, and likelihood of recommending it to others. Descriptive statistics were calculated and comments were thematically analyzed to guide the development of a revised METRIQ (rMETRIQ) score.Results: A total of 309 emergency medicine attendings, residents, and medical students completed the survey.The majority of participants felt the METRIQ-8 score was easy to use (mean AE SD = 2.7 AE 1.1 out of 7, with 1 indicating strong agreement) and would recommend it to others (2.7 AE 1.3 out of 7, with 1 indicating strong agreement). The thematic analysis suggested clarifying ambiguous questions, shortening the 7-point scale, specifying scoring anchors for the questions, eliminating the "unsure" option, and grouping-related questions. This analysis guided changes that resulted in the rMETRIQ score.Conclusion: Feedback on the METRIQ-8 score contributed to the development of the rMETRIQ score, which has improved clarity and usability. Further validity evidence on the rMETRIQ score is required.W ith increasing expansion of emergency medicine (EM) blogs and podcasts, residents frequently use these open educational resources to supplement and potentially replace traditional tools. 1-4 Unlike textbooks and journals, these online resources are rarely peer-reviewed 5-7 and critics raise concerns that learners From the

No abstract

The average scores of each blog post correlated strongly with gestalt ratings. However, neither ALiEM AIR nor METRIQ-8 showed higher reliability than gestalt. Improved reliability may be possible through rater training and instrument refinement.

Background Free open‐access medical education (FOAM) has become an integral resource for medical school and residency education. However, questions of quality and inconsistent coverage of core topics remain. In this second entry of the SAEM Systematic Online Academic Resource (SOAR) series, we describe the application of a systematic methodology to identify, curate, and describe FOAM topics specific to endocrine, metabolic, and nutritional disorders as defined by the 2016 Model of the Clinical Practice of Emergency Medicine (MCPEM). Methods We developed an automated algorithm to search 264 keywords derived from nine subtopics within the MCPEM category in the FOAM Search (a customized FOAM search tool) and the Social Media index. The top 100 results were extracted for each keyword. Resources underwent a manual iterative screening process, and those relevant to endocrine, metabolic, or nutritional disorders and EM were evaluated with the revised Medical Education Translational Resources: Impact and Quality (rMETRIQ) tool. Results The search yielded 36,346 resources, of which 756 met the criteria for quality assessment. After rMETRIQ tool training, four raters demonstrated an average measured intraclass correlation coefficient of 0.94 (95% confidence interval = 0.88 to 0.97, p < 0.001). A total of 121 posts (16% of posts) covering 25 subtopics were identified as high quality (rMETRIQ ≥16). The most covered subtopic was potassium disorders, representing 15% of all posts. Subtopics that did not have a high‐quality resource identified include metabolic alkalosis, respiratory alkalosis, fluid overload, phosphorus metabolism, hyperglycemia, malabsorption, malnutrition, and thyroiditis. From most to least common, the overall target audience was junior resident (91%), PGY‐1 resident (88%), senior resident (81%), clerk (64%), attending (50%), and preclerkship (9%). Conclusions We systematically identified, described, and curated FOAM resources for EM learners on the topic of endocrine, metabolic, and nutritional disorders. A final list of high‐quality resources can guide trainees, educator recommendations, and FOAM authors.

Citations have long been the leading metric for articles, with the citation-based journal impact factor being the primary journal metric. As the world becomes increasingly digital, altmetrics ("alternative metrics," including article page views and measures of social media sharing, such as the proprietary Altmetric attention score) have become more important in assessing the spread or potential value of a given scientific article. 1 Giustini and colleagues 2 compare citations with altmetrics in the pediatric literature. This study of pediatric articles highlights that while an article's altmetrics are associated with future citations, most articles have very low metrics across all measures; only a very small fraction of articles account for most citations, page views, and other altmetrics. 2 Medicine has traditionally used article citations and the impact factor of the journal in which an article is published as a surrogate measure of quality. Altmetrics may be better described as a marker