Comparison of Expert and Novice Performance of a Simulated Transesophageal Echocardiography Examination

Bick, Julian S.; DeMaría, Samuel; Kennedy, Jason D.; Schwartz, Andrew D.; Weiner, Menachem M.; Levine, Adam I.; Shi, Yaping; Schildcrout, Jonathan S.; Wagner, Chad E.

doi:10.1097/sih.0b013e31829068df

Cited by 22 publications

(21 citation statements)

References 10 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In addition, many studies used convenience samples that were not powered, and none of the studies calculated the number of participants required to achieve statistical significance, with one study commenting that their study was not adequately powered to detect differences between their two academic sites. 55 Many of the studies (n=13) were pilots or had small numbers (<50) of participants (range: n=18 to n=45). A small number of studies were conducted across different health centers 55 – 57 ; however, the majority of these were conducted in a single health setting or university, making it difficult to generalize the findings.…”

Section: Methodsmentioning

confidence: 99%

“… 55 Many of the studies (n=13) were pilots or had small numbers (<50) of participants (range: n=18 to n=45). A small number of studies were conducted across different health centers 55 – 57 ; however, the majority of these were conducted in a single health setting or university, making it difficult to generalize the findings. The included articles had scores on the critical appraisal tool ranging from 8 to 14/15.…”

Section: Methodsmentioning

confidence: 99%

See 1 more Smart Citation

Simulation-based assessments in health professional education: a systematic review

Ryall

Judd

Gordon

2016

JMDH

105

View full text Add to dashboard Cite

IntroductionThe use of simulation in health professional education has increased rapidly over the past 2 decades. While simulation has predominantly been used to train health professionals and students for a variety of clinically related situations, there is an increasing trend to use simulation as an assessment tool, especially for the development of technical-based skills required during clinical practice. However, there is a lack of evidence about the effectiveness of using simulation for the assessment of competency. Therefore, the aim of this systematic review was to examine simulation as an assessment tool of technical skills across health professional education.MethodsA systematic review of Cumulative Index to Nursing and Allied Health Literature (CINAHL), Education Resources Information Center (ERIC), Medical Literature Analysis and Retrieval System Online (Medline), and Web of Science databases was used to identify research studies published in English between 2000 and 2015 reporting on measures of validity, reliability, or feasibility of simulation as an assessment tool. The McMasters Critical Review for quantitative studies was used to determine methodological value on all full-text reviewed articles. Simulation techniques using human patient simulators, standardized patients, task trainers, and virtual reality were included.ResultsA total of 1,064 articles were identified using search criteria, and 67 full-text articles were screened for eligibility. Twenty-one articles were included in the final review. The findings indicated that simulation was more robust when used as an assessment in combination with other assessment tools and when more than one simulation scenario was used. Limitations of the research papers included small participant numbers, poor methodological quality, and predominance of studies from medicine, which preclude any definite conclusions.ConclusionSimulation has now been embedded across a range of health professional education and it appears that simulation-based assessments can be used effectively. However, the effectiveness as a stand-alone assessment tool requires further research.

show abstract

Section: Methodsmentioning

confidence: 99%

Section: Methodsmentioning

confidence: 99%

Simulation-based assessments in health professional education: a systematic review

Ryall

Judd

Gordon

2016

JMDH

105

View full text Add to dashboard Cite

show abstract

“…Experience and expertise are valuable to employers; for example, 81% of U.S. employers pay for and encourage their employees to learn and enhance their skill sets (Germain 2011), but how are experts distinguished from novice employees. Simulators have been used extensively in the medical field for training, as well as for studies investigating the difference in performance between different experience levels (Bick et al 2013;Conway et al 2014;Mandava et al 2015). None of these studies found here have distinguished any type of distributions for either the novice or expert sample groups (Ueda et al 2010;Bick et al 2013;Conway et al 2014;Mandava et al 2015;Mazomenos et al 2016;Cahill et al 2018).…”

Section: Introductionmentioning

confidence: 83%

“…Simulators have been used extensively in the medical field for training, as well as for studies investigating the difference in performance between different experience levels (Bick et al 2013;Conway et al 2014;Mandava et al 2015). None of these studies found here have distinguished any type of distributions for either the novice or expert sample groups (Ueda et al 2010;Bick et al 2013;Conway et al 2014;Mandava et al 2015;Mazomenos et al 2016;Cahill et al 2018). One paper that studied expert and novice performs in a specific task that neither had extensive experience in, found that there were a few cases where the students had a higher performance value than the experts, but overall the experts had a lower variance.…”

Section: Introductionmentioning

confidence: 99%

Comparative statistical analysis of simulated ice management effectiveness

Price

Yulmetova

Khalil

2019

Saf. Extreme Environ.

View full text Add to dashboard Cite

Ice management is critical for safe and efficient operations in ice-covered waters; thus, it is important to understand the impact of the operator's experience in effective ice management performance. This study evaluated the confidence intervals of the mean and probability distributions of two different sample groups, novice cadets and experienced seafarers, to evaluate if there was a difference in effective ice management depending on the operator's level of experience. The ice management effectiveness, in this study, is represented by the "clearing-to-distance ratio" that is the ratio between the area of cleared ice (km 2 ) and the distance travelled by an ice management vessel (km) to maintain that cleared area. The data analysed in this study was obtained from a recent study conducted by Memorial University's "Safety at Sea" research group. With the distribution fitting analysis providing inconclusive results regarding the normality of the data, the confidence intervals of the dataset means were obtained using both parametric approaches, such as t-test, Cox's method, and Johnson t-approach, and non-parametric methods, namely Jackknife and Bootstrap methods, to examine if the assumption of normality was valid. The comparison of the obtained confidence interval results demonstrates that the mean efficiency of the cadets is more consistent, while it is more varied among seafarers. The noticeable difference in ice management performance between the cadet and seafarer sample groups is revealed, thus, proving that crew experience positively influences ice management effectiveness.Keywords Risk management of offshore operations . Confidence interval . Johnson t-approach . Cox's method . Bootstrap . Jackknife Safety in Extreme Environments (2020) 2:79-91 https://doi.

show abstract

“…In this paper, we: i) describe the development of a tool to assess global quality of published genetic association studies, ii) evaluate the tool’s reliability and validity, and iii) investigate whether the reliability and validity of the tool differs based on user’s familiarity with genetic association studies, since there is some evidence to suggest that experts outperform novices on evaluations involving knowledge across different content areas [ 10 – 13 ].…”

Section: Introductionmentioning

confidence: 99%

Assessing the quality of published genetic association studies in meta-analyses: the quality of genetic studies (Q-Genie) tool

et al. 2015

View full text Add to dashboard Cite

BackgroundAdvances in genomics technology have led to a dramatic increase in the number of published genetic association studies. Systematic reviews and meta-analyses are a common method of synthesizing findings and providing reliable estimates of the effect of a genetic variant on a trait of interest. However, summary estimates are subject to bias due to the varying methodological quality of individual studies. We embarked on an effort to develop and evaluate a tool that assesses the quality of published genetic association studies. Performance characteristics (i.e. validity, reliability, and item discrimination) were evaluated using a sample of thirty studies randomly selected from a previously conducted systematic review.ResultsThe tool demonstrates excellent psychometric properties and generates a quality score for each study with corresponding ratings of ‘low’, ‘moderate’, or ‘high’ quality. We applied our tool to a published systematic review to exclude studies of low quality, and found a decrease in heterogeneity and an increase in precision of summary estimates.ConclusionThis tool can be used in systematic reviews to inform the selection of studies for inclusion, to conduct sensitivity analyses, and to perform meta-regressions.Electronic supplementary materialThe online version of this article (doi:10.1186/s12863-015-0211-2) contains supplementary material, which is available to authorized users.

show abstract

Comparison of Expert and Novice Performance of a Simulated Transesophageal Echocardiography Examination

Cited by 22 publications

References 10 publications

Simulation-based assessments in health professional education: a systematic review

Simulation-based assessments in health professional education: a systematic review

Comparative statistical analysis of simulated ice management effectiveness

Assessing the quality of published genetic association studies in meta-analyses: the quality of genetic studies (Q-Genie) tool

Contact Info

Product

Resources

About