Intra-Rater and Inter-Rater Reliability of Tongue Coating Diagnosis in Traditional Chinese Medicine Using Smartphones: Quasi-Delphi Study

Abstract

<jats:sec> <jats:title>Background</jats:title> <jats:p>There is a growing trend in the use of mobile health (mHealth) technologies in traditional Chinese medicine (TCM) and telemedicine, especially during the coronavirus disease (COVID-19) outbreak. Tongue diagnosis is an important component of TCM, but also plays a role in Western medicine, for example in dermatology. However, the procedure of obtaining tongue images has not been standardized and the reliability of tongue diagnosis by smartphone tongue images has yet to be evaluated.</jats:p> </jats:sec> <jats:sec> <jats:title>Objective</jats:title> <jats:p>The first objective of this study was to develop an operating classification scheme for tongue coating diagnosis. The second and main objective of this study was to determine the intra-rater and inter-rater reliability of tongue coating diagnosis using the operating classification scheme.</jats:p> </jats:sec> <jats:sec> <jats:title>Methods</jats:title> <jats:p>An operating classification scheme for tongue coating was developed using a stepwise approach and a quasi-Delphi method. First, tongue images (n=2023) were analyzed by 2 groups of assessors to develop the operating classification scheme for tongue coating diagnosis. Based on clinicians’ (n=17) own interpretations as well as their use of the operating classification scheme, the results of tongue diagnosis on a representative tongue image set (n=24) were compared. After gathering consensus for the operating classification scheme, the clinicians were instructed to use the scheme to assess tongue features of their patients under direct visual inspection. At the same time, the clinicians took tongue images of the patients with smartphones and assessed tongue features observed in the smartphone image using the same classification scheme. The intra-rater agreements of these two assessments were calculated to determine which features of tongue coating were better retained by the image. Using the finalized operating classification scheme, clinicians in the study group assessed representative tongue images (n=24) that they had taken, and the intra-rater and inter-rater reliability of their assessments was evaluated.</jats:p> </jats:sec> <jats:sec> <jats:title>Results</jats:title> <jats:p>Intra-rater agreement between direct subject inspection and tongue image inspection was good to very good (Cohen κ range 0.69-1.0). Additionally, when comparing the assessment of tongue images on different days, intra-rater reliability was good to very good (κ range 0.7-1.0), except for the color of the tongue body (κ=0.22) and slippery tongue fur (κ=0.1). Inter-rater reliability was moderate for tongue coating (Gwet AC2 range 0.49-0.55), and fair for color and other features of the tongue body (Gwet AC2=0.34).</jats:p> </jats:sec> <jats:sec> <jats:title>Conclusions</jats:title> <jats:p>Taken together, our study has shown that tongue images collected via smartphone contain some reliable features, including tongue coating, that can be used in mHealth analysis. Our findings thus support the use of smartphones in telemedicine for detecting changes in tongue coating.</jats:p> </jats:sec>

Patient Reported Traditional Chinese Medicine Spleen Deficiency Syndrome (TCM-SDS) Scale for Colorectal Cancer: Development and Validation in China

“…Other methods, for example artificial intelligence (AI) tongue diagnosis, still have barriers for clinical utilization. 23 In our study, we found that CRC patients with metastatic disease had higher TCM-SDS score than those in early stage. Although patients with advanced disease usually had higher symptom burden, whether TCM-SDS score could predict survival outcomes still needs further evaluation.…”

Tongue Inspection and Diagnosis: Past, Present, and Future

“…Inter-agreements between the ATDS and TCM doctors, as well as among the TCM doctors are both moderate. Intra-rater agree- ment between direct subject tongue inspection and objective tongue image inspection was good (Cohen κ range 0.69-1.0) [5].…”

PRAgmatic Clinical Trial Design of Integrative MediCinE (PRACTICE): A Focus Group Series and Systematic Review on Trials of Diabetes and Kidney Disease

“…However, the intervention evaluated by pragmatic trials are often programs requiring flexibility, and the reproducibility is scrutinized (1). Although an unrestricted replicate of the real-world practice best produces evidence on effectiveness for implementation, the protocol may neither be applicable to nor reproducible in other clinical settings as high-quality standardized diagnostic instruments are lacking (50)(51)(52). For instance, the CM symptom-based diagnosis and personalized treatment in diabetes involves subjective professional judgment and likely differs between CM physicians.…”