Validation of Inter-Rater and Intra-Rater Reliability of Remote Dielectric Sensing Measurement

Abstract

Remote dielectric sensing (ReDS) is a recently introduced non-invasive electromagnetic-based device used to quantify lung fluid levels. Nevertheless, its inter-rater and intra-rater reliability remain uncertain. In 10 healthy volunteers, ReDS values were measured three times successively by the officially trained expert examiner to validate intra-rater reliability. Similar measures were performed by a total of three examiners to validate inter-rater reliability. Intra-class correlation (ICC) was applied to validate each reliability. Ten healthy volunteers [median 34 (32, 40) years old, 10 men, body mass index 23.0 (21.2, 23.9)] were included. Median ReDS value was 28% (25%, 31%). For the intra-rater reliability, ICC (1, 1) and ICC (1, 3) were 0.966 and 0.988, respectively (P < 0.001). For the inter-rater reliability, ICC (2, 1) and ICC (2, 3) were 0.683 and 0.866, respectively (P < 0.001). Given almost perfect intra-rater reliability, an examiner does not need to repeat ReDS measurement. Given substantial inter-rater reliability, ReDS measurements had better be measured by multiple examiners if possible.

Lung fluid content during 6MWT in patients with COPD with and without comorbid heart failure

“…In this regard, the reproducibility of ReDS measurements becomes a crucial issue. Thankfully, a recent study by Hori et al 25 has demonstrated an almost perfect agreement between repeated ReDS measurements. Consequently, a >2% change in ReDS values should be deemed clinically meaningful and applicable in daily practice.…”

“…Similarly, another two measurements were made right after the end of the 6MWT. One study has shown almost perfect intrarater reliability of the ReDS system, with an intraclass correlation of 0.966–0.988 25. The operator was blinded to the clinical information of the study participants.…”

Noninvasive assessment of pulmonary congestion in heart failure: Need of the hour

“…However, almost perfect reliability could be achieved via examination by two raters. 22 Other factors are also studied that could affect the ReDS measurement. For example, it was reported that ReDS measurement should be conducted in a sitting posture.…”

Effect of measurement procedure errors on assessing lung fluid via remote dielectric sensing system

“…While the ReDS system is acknowledged for its ability to provide reproducible information regarding lung fluid content, it is crucial to adhere to the manufacturer’s instructions when taking measurements. In a pioneer study by Hori et al 10 , the inter-rater and intra-rater reliability of ReDS measurements were examined. The results revealed a high level of intra-rater reliability, with intra-class correlation coefficients ranging from 0.966 to 0.988 10 .…”

“…In a pioneer study by Hori et al 10 , the inter-rater and intra-rater reliability of ReDS measurements were examined. The results revealed a high level of intra-rater reliability, with intra-class correlation coefficients ranging from 0.966 to 0.988 10 . However, it is worth noting that the inter-rater reliability exhibited a lower intra-class correlation coefficient of 0.683 10 .…”