Interrater reliability to assure valid content in peer review of CME-accredited presentations

Quigg, Mark; Lado, Fred A.

doi:10.1002/chp.20042

Journal of Continuing Education in the Health Professions

2009

DOI: 10.1002/chp.20042

|View full text |Cite

Interrater reliability to assure valid content in peer review of CME-accredited presentations

Mark Quigg

Fred A. Lado

Abstract: Interrater reliability on the rating of durable materials used in subspecialty CME was poor. Guidelines for CME appropriate content are too subjective to be applied reliably by raters knowledgeable in their specialty field but relatively untrained in the specifics of CME requirements. The process of peer review of CME materials would be aided by education of physicians on validation of materials appropriate for CME.

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...

Citation Types

Supporting

Mentioning

Contrasting

Year Published

2010

2022

Publication Types

Select...

Article2

Relationship

Self Cite0

Independent2

Authors

Journals

Cited by 2 publications

(1 citation statement)

References 3 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…16 Although studies show that physicians do not perceive differences in commercial bias between industryfunded and non-industry funded CME, 16−20 it is unclear whether physicians can accurately assess the independence or scientific validity of CME activities. 21 An educational intervention about industry influence was developed for grand rounds presentations by physicians associated with PharmedOut (http://www.pharmedout.org), a university-based physician-run project founded with public funds to educate physicians and medical students about inappropriate pharmaceutical promotion. This article describes the effects of this intervention.…”

mentioning

confidence: 99%

Why lunch matters: Assessing physicians' perceptions about industry relationships *

Fugh‐Berman

Bell

2010

Journal of Continuing Education in the Health Professions

View full text Add to dashboard Cite

Many studies have shown that pharmaceutical marketing affects prescribing choices. Studies that have assessed the effects of educational interventions on perceptions of pharmaceutical promotion have found mixed results. This study assesses the short-term effects of an educational intervention about marketing tactics on the attitudes and fund of knowledge of residents, medical students, and attending physicians. A 1-hour slide show that covered detailing, prescription tracking, drug samples, medical meetings, and journals was developed by PharmedOut and presented at a total of 14 grand rounds and seminars at departments of family medicine, internal medicine, pediatrics, psychiatry, cardiology, and neurology. Pre- and posttests included attitudinal and fact questions addressing the influence of drug reps, gifts, pharmaceutical advertising and drug samples on prescribing behavior. The posttest asked whether attendees intended to change their prescribing behavior. The Mann-Whitney U test was used for Likert-scale questions and the Fisher exact test was used to compare the number of pre- and posttest correct answers for the multiple choice and true/false questions. Three hundred seventy-three participants completed pre- and posttests. Significant attitudinal shifts were seen overall, particularly in questions addressing influence of salespeople on physicians in general and on the respondent individually. Some participants commented that they intended to stop seeing drug reps or stop attending industry-funded meals. A new educational presentation can substantially shift attitudes toward perceived susceptibility to pharmaceutical marketing activities. Further research is needed to see if attitude change persists.

show abstract

mentioning

confidence: 99%

Why lunch matters: Assessing physicians' perceptions about industry relationships *

Fugh‐Berman

Bell

2010

Journal of Continuing Education in the Health Professions

View full text Add to dashboard Cite

show abstract

Continuing Education Courses for Orthopedic and Sports Physical Therapists in the United States Often Lack Supporting Evidence: A Review of Available Intervention Courses

et al. 2022

View full text Add to dashboard Cite

Objective The purpose of this study was to characterize the extent to which orthopedic and sports-related continuing education course descriptions approved for physical therapists in the United States taught interventions supported by evidence. Methods A review was conducted of courses available on CEU Locker from January through December 2020, estimated to represent most courses available nationally to physical therapists. This review focused specifically on courses teaching interventions for musculoskeletal conditions in adults. Specifically, courses for orthopedic and sports populations were identified. All course information was extracted, including the intervention name, course description, and target audience. Finally, clinical practice guidelines (CPGs) and systematic reviews with at least moderate level evidence published through May 1, 2021 were searched to determine if treatments were recommended, not recommended, or no evidence existed. Results The review identified 2406 available courses that were extracted from the database. After excluding courses that did not meet inclusion criteria, duplicates, and those with incomplete or inadequate information, the final number was 319. Most courses (52.7%, n = 168) taught interventions that were not supported by a CPG or systematic review. About one third of courses (34.2%, n = 109) taught interventions that were recommended by a CPG. Many courses were targeted to multiple disciplines (38.9%, n = 124), whereas 89 (27.9%) were specifically for physical therapists, physical therapist assistants, or both. The specific target was unclear for 106 (33.2%) courses. Courses usually focused on multiple body regions, and exercise was the most included intervention. Soft-skill courses were the most supported by evidence (82.9%, n = 29), whereas those teaching modalities were the least supported (30.5%, n = 29). Conclusion Fewer than half of courses that focused on management of musculoskeletal disorders taught interventions supported by a CPG or systematic review, and course descriptions often misrepresented the current state of evidence. Courses required for licensure renewal might not be meeting the intended goal of keeping clinicians current with new and emerging research. Impact Relatively few continuing education courses on orthopedic and sports-related physical therapist interventions are based on evidence provided by CPGs or systematic reviews; and some continuing education options that are required for physical therapists to meet annual licensure renewal requirements might not be keeping therapists current with the latest evidence. This study provides data that can facilitate candid dialog within the profession about potential solutions.

show abstract

scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.

Contact Info

customersupport@researchsolutions.com

10624 S. Eastern Ave., Ste. A-614

Henderson, NV 89052, USA

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Blog Terms and Conditions API Terms Privacy Policy Contact Cookie Preferences Do Not Sell or Share My Personal Information

Made with 💙 for researchers

Part of the Research Solutions Family.

Interrater reliability to assure valid content in peer review of CME-accredited presentations

Cited by 2 publications

References 3 publications

Why lunch matters: Assessing physicians' perceptions about industry relationships *

Why lunch matters: Assessing physicians' perceptions about industry relationships *

Continuing Education Courses for Orthopedic and Sports Physical Therapists in the United States Often Lack Supporting Evidence: A Review of Available Intervention Courses

Contact Info

Product

Resources

About