Background: E-consultation medical services have become popular globally, which offers patients more options, regardless of time or location. However, research indicates a prevalent issue with the communication quality in e-consultations, leading to sub-optimal patient experiences.Objective: This study aims to design an evaluation system for e-consultation quality. The developed scale guides operators in improving services and users in assessing their experience. It aids in selecting e-consultation services, saving costs, and assisting doctors in making informed decisions. Methods: This study combines existing scales, literature analysis, and expert consultation to form preliminary evaluation indicators. Fourteen experts were invited using stratified purposive sampling. Two rounds of Delphi method were conducted to exclude indicators that did not meet basic conditions. The final evaluation system was determined through expert discussions and revisions. The Analytic Hierarchy Process (AHP) quantified indicator weights. Results: Both rounds of the questionnaire saw compelling response rates of 100% (14 out of 14) and 92.86% (13 out of 14), respectively. Meanwhile, the Expert Authority Coefficient (Cr) was recorded at 0.89 and 0.88, respectively, while the Kendall Consistency Coefficient (Kendall W) for all level indicators fluctuated between 0.133 and 0.37 (P<0.05). The ultimate indicator system formulated includes three primary indicators, ten secondary indicators, and thirty-two tertiary indicators. The highest to lowest weighted first-level indicators were 'Joint Decision-Making between Doctors and Patients' (0.6232), 'Patient Responsiveness' (0.2395), and "Interpersonal Relationship between Doctors and Patients" (0.1373). Weights for the second-level and third-level indicators were also determined.
Conclusion:A scientific scale for e-consultation quality evaluation has been created, which effectively captures the essence of online medical communication and patient experiences. It enriches the theoretical framework for evaluating e-consultation quality, broadens perspectives in Internet medicine, provides practical guidance for network medical service managers and users and the development of the "Internet + medical health" service model.