(Re)Visualizing Rater Agreement: Beyond Single-Parameter Measures

Eubanks, David

doi:10.37514/jwa-j.2017.1.1.10

Cited by 4 publications

(3 citation statements)

References 18 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Within these rectangles, concordance or deviation from the diagonal of the contingency table are represented by further rectangles with different shading. Black indicates concordance, lighter shading represents stronger deviations from the diagonal of the contingency table (31). Comparable to the kappa statistic, a single ratio for agreement can be derived, which accounts for chance agreement (28).…”

Section: Discussionmentioning

confidence: 99%

Self-reported Versus Physician-reported Severity of Chronic Hand Eczema: Concordance Analysis Based on Data from the German Chronic Hand Eczema Patient Long-Term Management Registry

Bentz

Apfelbacher

Akst³

et al. 2023

Acta Derm Venereol

View full text Add to dashboard Cite

Self-assessment of general health status has a significant influence on patient-related outcomes. The aims of this study were to investigate and compare the level of agreement between patients’ and dermatologists’ assessments of the severity of chronic hand eczema. From the German registry “German Chronic Hand Eczema Patient Long-Term Management Registry” (CARPE), 1,281 pairs of patients with chronic hand eczema and their dermatologists were included. Of these, 788 pairs served as a comparison 2 years after baseline. Concordance analyses found that complete concordance between patients’ and dermatologists’ assessments were 16.62% at baseline and 11.47% at follow-up. Overall, patients assessed their chronic eczema at baseline as more severe than did the dermatologists; whereas, at follow-up, patients assessed their condition as less severe than the dermatologists’ assessment. Bangdiwala’s B showed lower values of concordance for womens’ and older patients’ self-assessment with the dermatologists’ assessments. In conclusion, dermatologists should consider the patient’s perspective and the individual’s assessment of their chronic hand eczema in order to provide effective care in clinical practice.

show abstract

Section: Discussionmentioning

confidence: 99%

Self-reported Versus Physician-reported Severity of Chronic Hand Eczema: Concordance Analysis Based on Data from the German Chronic Hand Eczema Patient Long-Term Management Registry

Bentz

Apfelbacher

Akst³

et al. 2023

Acta Derm Venereol

View full text Add to dashboard Cite

show abstract

“…In addition, there is the possibility of adding a visual aspect to the otherwise commonly encountered single parameter measurement of concordance, which can provide new insights on its own and is not available in conventional concordance measures [28,30]. This central element of the concordance measure developed by Bangdiwala is the "agreement chart", which is a visualization of a k*k contingency table.…”

Section: Methodsmentioning

confidence: 99%

Self-reported versus physician-reported severity of hand eczema - Concordance analysis based on data from the German CARPE registry

Bentz

Apfelbacher

Akst³

et al. 2022

Preprint

View full text Add to dashboard Cite

Background and Objective: Self-assessment of general health status includes a variety of verifiable objective and subjective criteria and shows a significant influence on patient-related outcomes such as quality of life. The objective of this study was to investigate how patients assess the severity of their chronic hand eczema compared to physicians.Patients and method: Data for 1281 patients and their physicians from the German registry “CARPE” was available at baseline. At a 2-year follow-up, the remaining 788 cases served as a comparison. Concordance analysis was performed using Bangdiwala's B.Results:Only 16.62% (baseline) and 11.47% (follow-up) of the severity ratings showed complete concordance. The baseline shows a more pessimistic, the follow-up a more optimistic assessment from the patients compared to the physicians. Women and older patients had lower agreement. Bangdiwala's B value lies at the lower border of a substantial agreement ( B̂ω(baseline)=0.573, B̂ω(follow-up)=0.498).Conclusion:The assessment of the severity of hand eczema often differs between physician and patient. To ensure successful therapy and adherence, dermatologists should inquire about their patients' individual perception of the severity of the hand eczema, especially in older patients and women.

show abstract

“…V posledných rokoch sa vytvárajú aj nové techniky pre zobrazenie napr. pre koeficient kappa (Eubanks, 2017) Názov a abstrakt:…”

Section: Faktory Vplývajúce Na Súhlasu/spoľahlivosti Posudzovateľovunclassified

Reportovanie súhlasu posudzovateľov a spoľahlivosti posudzovateľov

Kočišová

2022

TESTFÓRUM

View full text Add to dashboard Cite

V psychológii ale aj v mnohých iných oblastiach sa stretneme s použitím ďalšieho posudzovateľa pre potvrdenie validity a reliability našich záverov. Ide o súhlas posudzovateľov (inter-rater agreement), ktorý predstavuje zhodu v ich hodnotení a ak je zhoda dosiahnutá, hodnotitelia sú zameniteľní (Tinsley, Weiss, 1975) a spoľahlivosť posudzovateľov (inter-rater reliability) v zmysle konzistencie hodnotenia (LeBreton, Senter, 2008). Oba koncepty sa okrem definovania líšia aj v zodpovedaní rôznych výskumných otázok a spôsobu štatistickej analýzy. Cieľom príspevku je zodpovedať otázky, ktoré súvisia s praktickou potrebou reportovania súhlasu posudzovateľov a spoľahlivosti posudzovateľov. S tým sú spojené otázky, na ktoré príspevok hľadá odpovede: Aký počet posudzovateľov je vhodné zvoliť? Ako si vybrať vhodný index súhlasu a spoľahlivosti posudzovateľov? Existujú akceptované miery súhlasu a spoľahlivosti posudzovateľov? Ktoré faktory vplývajú na mieru súhlasu a spoľahlivosti posudzovateľov?

show abstract

(Re)Visualizing Rater Agreement: Beyond Single-Parameter Measures

Cited by 4 publications

References 18 publications

Self-reported Versus Physician-reported Severity of Chronic Hand Eczema: Concordance Analysis Based on Data from the German Chronic Hand Eczema Patient Long-Term Management Registry

Self-reported Versus Physician-reported Severity of Chronic Hand Eczema: Concordance Analysis Based on Data from the German Chronic Hand Eczema Patient Long-Term Management Registry

Self-reported versus physician-reported severity of hand eczema - Concordance analysis based on data from the German CARPE registry

Reportovanie súhlasu posudzovateľov a spoľahlivosti posudzovateľov

Contact Info

Product

Resources

About