Using facial reaction analysis and machine learning to objectively assess palatability of medicines in children

Abstract

For orally administered drugs, palatability is key in ensuring patient acceptability and treatment compliance. Therefore, understanding children's taste sensitivity and preferences can support formulators in making paediatric medicines more acceptable. Presently, we explore if the application of computer-vision techniques to videos of children's reaction to gustatory taste strips can provide an objective assessment of palatability. Primary school children tasted four different flavoured strips: no taste, bitter, sweet and sour. Data was collected at home, under the supervision of a guardian, with responses recorded using the Aparito Atom5™ app and smartphone camera. Participants scored each strip on a 5-point hedonic scale. Facial landmarks were identified in the videos, and quantitative measures such as changes around the eyes, nose and mouth were extracted to train models to classify strip taste and score. We received 197 videos and 256 self-reported scores from 64 participants. The hedonic scale elicited expected results: children like sweetness, dislike bitterness and have varying opinions for sourness. The findings revealed the complexity and variability of facial reactions and highlighted specific measures, such as eyebrow and mouth corner elevations, as significant indicators of palatability. This study into children's taste specificities can improve the measurement of paediatric medicine acceptability. An objective measure of how children feel about the taste of medicines has great potential in helping find the most palatable formulation. Moreover, collecting data in the home setting allows for natural behaviour, with minimal burden for participants.