Said Another Way Subject Matter Experts: Facts or Fiction?

Lavin, Roberta Proffitt; Dreyfus, Michael; Slepski, Lynn A.; Kasper, Christine E.

doi:10.1111/j.1744-6198.2007.00087.x

Cited by 12 publications

(9 citation statements)

References 5 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The inter‐rater reliability in this study was evaluated by the use of ICC and showed no difference between the assessors. This demonstrated that the methodology used to construct the marking schemes was effective and efficient both in allowing accurate assignment of a score for the assessment items, while allowing markers to demonstrate their expert status [21]. Another important facet of assessment construction is generalizability (G) theory.…”

Section: Discussionmentioning

confidence: 99%

“…The SME panel members then used an iterative process to write and review the assessments and the marking schemes. The varying levels of clinical experience brought by the SME allowed them to gauge the level/difficulty of the questions, as well as associating them with current in‐hospital practice [21]. Through this process the items were set at a level the panel felt a junior doctor should be able to achieve.…”

Section: Methodsmentioning

confidence: 99%

See 1 more Smart Citation

The performance of junior doctors in applying clinical pharmacology knowledge and prescribing skills to standardized clinical cases

Harding

Britten

Bristow

2010

Brit J Clinical Pharma

View full text Add to dashboard Cite

WHAT IS ALREADY KNOWN ABOUT THIS SUBJECT• Safe prescribing is a core competency in undergraduate medical education.• A large proportion of undergraduate medical students and recently graduated doctors in the UK are not confident in their ability to prescribe effectively and safely.• Errors are common in all healthcare settings and prescribing errors are the most common type. WHAT THIS STUDY ADDS• This study produced twelve valid and statistically reliable assessments of clinical pharmacology and therapeutics (CPT) knowledge and prescribing skills in areas that pose a high risk to patient safety. • The findings show that a large proportion of foundation year 1 (FY1) doctors fail to demonstrate the level of CPT knowledge and prescribing ability judged by a subject matter expert (SME) panel to be required at this stage of their careers.• We suggest strategies and areas where teaching can be focused to improve the safety and effectiveness of prescribing by FY1 doctors. AIMSRecent studies suggest a worryingly high proportion of final year medical students and new doctors feel unprepared for effective and safe prescribing. Little research has been undertaken on UK junior doctors to see if these perceptions translate into unsafe prescribing practice. We aimed to measure the performance of foundation year 1 (FY1) doctors in applying clinical pharmacology and therapeutics (CPT) knowledge and prescribing skills using standardized clinical cases. METHODSA subject matter expert (SME) panel constructed a blueprint, and from these, twelve assessments focusing on areas posing high risk to patient safety and deemed as essential for FY1 doctors to know were chosen. Assessments comprised six extended matching questions (EMQs) and six written unobserved structured clinical examinations (WUSCEs) covering seven CPT domains. Two of each assessment types were administered over three time points to 128 FY1 doctors. RESULTSThe twelve assessments were valid and statistically reliable. Across seven CPT areas tested 51-75% of FY1 doctors failed EMQs and 27-70% failed WUSCEs. The WUSCEs showed three performance trends; 30% of FY1 doctors consistently performing poorly, 50% performing around the passing score, and 20% performing consistently well. Categorical rating of the WUSCEs revealed 5% (8/161) of scripts contained errors deemed as potentially lethal. CONCLUSIONSThis study showed that a large proportion of FY1 doctors failed to demonstrate the level of CPT knowledge and prescribing ability required at this stage of their careers. We identified areas of performance weakness that posed high risk to patient safety and suggested ways to improve the prescribing by FY1 doctors.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Methodsmentioning

confidence: 99%

The performance of junior doctors in applying clinical pharmacology knowledge and prescribing skills to standardized clinical cases

Harding

Britten

Bristow

2010

Brit J Clinical Pharma

View full text Add to dashboard Cite

show abstract

“…Each of the SMEs had more than 20 years of service in the police force. Instructors attached to the training wing occupied this role based on their knowledge of police tactics and their ability to observe and guide colleagues (see Lavin et al, 2007 , for a critical discussion of the use of SMEs). The leaders of the training wing were also involved in designing the study, including the variables used.…”

Section: Methodsmentioning

confidence: 99%

Teamwork on Patrol: Investigating Teamwork Processes and Underlaying Coordinating Mechanisms in a Police Training Program

et al. 2021

View full text Add to dashboard Cite

The Big Five theory suggests that five components in teamwork are essential for team effectiveness in stressful environments. Furthermore, three coordinating mechanisms are claimed to be decisive to upholding and informing vital teamwork processes. Although much research has been conducted into the Big Five theory and its components, to the best of our knowledge, no study has yet been made of the relative importance of the three mechanisms and their impact on team effectiveness. Also, only a few studies have tried to investigate whether the components and the coordinating mechanisms are trainable. This study aims to make a theoretical contribution to the part of the theory focusing on the coordinating mechanisms. Secondly, it investigates whether training can improve team performance. Working in teams of two, 166 police officers participated in a simulated operational scenario. Correlational analyses indicated that all Big Five teamwork behaviors and coordinating mechanisms relate to external ratings of team performance. Only the mechanisms of Closed Loop Communication (CLC) and Shared Mental Model (SMM) predicted performance indicators, with SMM predicting above and beyond the effect of CLC. No effect of the training program was found. The study provides new evidence in a police situation that the most important coordinating mechanism of the Big Five theory is that of shared mental models, which in turn has consequences for the type of training needed.

show abstract

“…Coastal. Lavin, R., Dreyfus, M., Slepski, L., Kasper, C. (2007). Said another way: subject matter experts: facts or fiction?…”

Section: E 33mentioning

confidence: 99%

Public Discourse in Energy Policy Decision-Making: Final Report

Citizen¹,

DeShazo²,

Freemuth³

et al. 2010

View full text Add to dashboard Cite

The ground is littered with projects that failed because of strong public opposition, including natural gas and coal power plants proposed in Idaho over the past several years. This joint project of the Idaho National Laboratory, Boise State University, Idaho State University and University of Idaho has aimed to reduce project risk through encouraging the public to engage in more critical thought and be more actively involved in public or social issues.Early in a project, project managers and decision-makers can talk with no one, pro and con stakeholder groups, or members of the public. Experience has shown that talking with no one outside of the project incurs high risk because opposition stakeholders have many means to stop most (if not all) energy projects. Talking with organized stakeholder groups provides some risk reduction from mutual learning, but organized groups tend not to change positions except under conditions of a negotiated settlement. Achieving a negotiated settlement may be impossible. Furthermore, opposition often arises outside preexisting groups.Standard public polling provides some information but does not reveal underlying motivations, intensity of attitudes, etc. Improved methods are needed that probe deeper into stakeholder (organized groups and members of the public) values and beliefs (sometimes called heuristics) to increase the potential for change of opinions and/or out-of-box solutions. The term "heuristics" refers to the mental short-cuts, underlying beliefs, and paradigms that everyone uses to filter and interpret information, to interpret what is around us, and to guide our actions and decisions.This document is the final report of a 3-year effort to test different public discourse methods in the subject area of energy policy decision-making. We analyzed 504 mail-in surveys and 80 meeting participants in deliberation groups on the Boise State University campus for their (a) reflective preference (off-the cuff answers), (b) financial support, or allocation of a hypothetical $100 among energy options, and (c) evaluations of eight attributes for five energy options: energy conservation and efficiency, fossil fuels, nuclear energy, hydropower, and renewable energy. All meeting participants saw a 7-person diverse energy expert panel. Some participants attended deliberation discussion sessions; some received a 35-page briefing document that included pros and cons of the different energy options. Of those who received the briefing paper, 90% viewed it positively, meaning our multi-discipline and multi-viewpoint approach to preparing the briefing paper achieved credibility among those with different energy option preferences.Compared with the average Idahoan, and due to self-selection versus the commercially-prepared demographically-balanced mailing list, respondents to the survey were more male (78% vs. 49%) , more formally educated (50% with 4-year degree vs. 16% of Idahoans in general), and more engaged (96% claimed to have voted in an election in the past two years vs. 61% t...

show abstract

Said Another Way Subject Matter Experts: Facts or Fiction?

Cited by 12 publications

References 5 publications

The performance of junior doctors in applying clinical pharmacology knowledge and prescribing skills to standardized clinical cases

The performance of junior doctors in applying clinical pharmacology knowledge and prescribing skills to standardized clinical cases

Teamwork on Patrol: Investigating Teamwork Processes and Underlaying Coordinating Mechanisms in a Police Training Program

Public Discourse in Energy Policy Decision-Making: Final Report

Contact Info

Product

Resources

About