The aim of this study was to propose a method to assess images of the tongue captured using a polarized light camera for diagnostic use in Kampo medicine. Glossy and non-glossy images of the tongue were captured simultaneously using a polarizing camera and a polarizing plate. Data augmentation was performed by modulating the color and gloss, resulting in an increase in the number of images from 11 to 275. To create a data set, the values for which diseases were evaluated by Kampo doctors for all tongue images were taken as the correct values and combined with the features extracted from the tongue images. Using this data set, we constructed a diagnostic support module to evaluate diseases. The resulting mean absolute error of the assessment was 0.44 for qi deficiency, 0.42 for blood deficiency, 0.33 for blood stagnation, 0.36 for yin deficiency, and 0.55 for fluid stagnation, suggesting that the diagnostic assistance module was accurate, and our proposed learning and data augmentation methods were effective.

No abstract

We developed a system to improve the quality of telemedicine, and the test results obtained have been presented in this paper, along with the technical details of the system. The spread of COVID-19 has accelerated the need for telemedicine to effectively prevent infections. However, in traditional Japanese medicine (Kampo), where color is essential, an accurate diagnosis cannot be made without color reproduction. Because commercial smartphones cannot reproduce colors with the level of fidelity required for medical treatments, we created a color chart that includes the human skin and tongue colors to help doctors identify their colors accurately during a telemedicine examination. Further, we developed a telemedicine system that allows for automatic color correction using a mobile device, with a color chart and non-contact heart rate measurements.

Regular observation and recording of the changes in body appearance are essential for the process of the treatment of plastic surgery and dermatology, especially aesthetic surgery. Usually, physicians treat patients with medical interviews, pictures of the patient's faces before and after their treatment, anatomical data that including size, location, and color of the affected skin. However, it is difficult to capture the affected area under the same conditions every time because the captured range varies depending on the imaging angle and distance. There is a need to record three-dimensional shape of face parts such as cheek, nose, eye, and chin. Therefore, in this study, the face shape and the skin color were measured using the infrared depth camera and the RGB camera built in the smartphone three-dimensionally. We measured before and after modulating the shape and color of the face, and then, the change in volume and the change in skin pigment of skin color was calculated and visualized. This method makes it possible to analyze the skin shape and color independently of the viewing angle and the illumination direction. In this study, the depth sensor built in the smartphone showed the potential to monitor changes in facial shape and skin color. In the future, it is expected to contribute to the development of telemedicine, in which the patient measures their face at home and gets medical treatment consultation remotely.

No abstract