Depth and thermal information fusion for head tracking using particle filter in a fall detection context

Halima, Imen; Laferté, Jean-Marc; Cormier, Geoffroy; Fougères, Alain-Jérôme; Dillenseger, Jean-Louis

doi:10.3233/ica-190615

Cited by 16 publications

(4 citation statements)

References 31 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…A device comprising depth and thermal sensors (step 1) is placed in a room (for our experiment, it was a room in a nursing home for a dependent elderly person). This device consisted in calibrated, paired depth and thermal sensors as described in [9], where the depth sensor was a Kinect-like sensor (640 × 480 px @ 30 fps), and the thermal sensor was a FLIR Lepton-like thermal camera (80 × 60 px @ 9 fps).…”

Section: Methodsmentioning

confidence: 99%

See 1 more Smart Citation

Detection of changes in the behaviour of the elderly person

Msaad¹,

Dillenseger²,

Cormier³

et al. 2021

2021 43rd Annual International Conference of the IEEE Engineering in Medicine &Amp; Biology Society (EMBC)

Self Cite

View full text Add to dashboard Cite

In this paper, we propose a solution for detecting changes in the behaviour of the elderly person based on the monitoring of activities of daily living (ADL). The elderly person's daily routine is characterized by the following five indexes: 1) percentage of time lying down, 2) percentage of time sitting, 3) percentage of time standing, 4) percentage of time absent from home, and 5) number of falls during the day. In our framework, these indexes are computed using characteristics extracted from depth and thermal data. We hypothesize that elderly persons have a well-defined, regular life routine, organized around their environment, habits, and social relations. Then, given the indexes values, a day is defined as routine or non-routine day. Thus, looking for changes of day type allows to detect changes in a person's routine. The method has been tested on a database of depth and thermal images recorded in a nursing home over an 85 days period. These tests proved the reliability of the proposed method.Clinical Relevance -Monitoring the daily routine provides indicators for detecting changes in the behaviour of an elderly person.

show abstract

Section: Methodsmentioning

confidence: 99%

“…Yet, constraints linked to the cost and intrusive nature of the sensors remain. In order to deal with cost and privacy issues, we recently developed a solution based on low-cost depth and thermal sensors [9]. In a previous work, we demonstrated the interest of this approach to detect a fall [10].…”

Section: Introductionmentioning

confidence: 99%

Detection of changes in the behaviour of the elderly person

Msaad¹,

Dillenseger²,

Cormier³

et al. 2021

2021 43rd Annual International Conference of the IEEE Engineering in Medicine &Amp; Biology Society (EMBC)

Self Cite

View full text Add to dashboard Cite

show abstract

“…In recent years, researchers attempted to fuse 2D-and 3D information of a particular scene to realize more possibilities in computer vision. Halima et al [22] contribute to detecting and tracking human heads by fusing depth and 2D thermal information. Attamimi et al [23] propose an object detection approach based on a particle filter with integrated color, texture, and depth information for the detection of everyday items.…”

Section: Introductionmentioning

confidence: 99%

3-D Refuse-Derived Fuel Particle Tracking-by-Detection Using a Plenoptic Camera System

Zhang

Vogelbacher

Hagenmeyer

et al. 2022

IEEE Trans. Instrum. Meas.

View full text Add to dashboard Cite

Multiple particle tracking-by-detection is a widely investigated issue in image processing. The paper presents approaches to detecting and tracking various refuse-derived fuel particles in a industrial environment using a plenoptic camera system, which is able to yield 2D gray value information and 3D point clouds with noticeable fluctuations. The presented approaches, including an innovative combined detection method and a post-processing framework for multiple particle tracking, aim at making the most of the acquired 2D and 3D information to deal with the fluctuations of the measuring system. The proposed novel detection method fuses the captured 2D gray value information and 3D point clouds, which is superior to applying single information. Subsequently, the particles are tracked by the linear Kalman filter and 2.5D global nearest neighbor (GNN) and joint probabilistic data association (JPDA) approach, respectively. As a result of several inaccurate detection results caused by the measuring system, the initial tracking results contain faulty and incomplete tracklets that entail a post-processing process. The developed post-processing approach based merely on particle motion similarity benefits a precise tracking performance by eliminating faulty tracklets, deleting outliers, connecting tracklets, and fusing trajectories. The proposed approaches are quantitatively assessed with manuelly labeled ground truth datasets to prove their availability and adequacy as well. The presented combined detection method provides the highest F1-score, and the proposed post-processing framework enhances the tracking performance significantly with regard to several recommended evaluation indices.

show abstract

“…Constraints remain linked to the intrusive nature of the sensors and to the cost. In order to solve the cost and privacy issues, we have recently developed a solution based on low-cost depth and thermal sensors [9]. In a previous work, we demonstrated the interest in this approach to detect the fall [10].…”

Section: Introductionmentioning

confidence: 99%

Interest of the minimum edit distance to detect behaviour change of the elderly person

Msaad

Dillenseger

Carrault

2021

2021 43rd Annual International Conference of the IEEE Engineering in Medicine &Amp; Biology Society (EMBC)

Self Cite

View full text Add to dashboard Cite

In this article, a solution to detect the change of behaviour of the elderly person based on the person's activities of daily living is proposed. This work is based on the hypothesis that the person attaches importance to a rhythmic sequence of days and activities per day. The day of the elderly person is described by a succession of activities, and each activity is associated to a posture (lying down, sitting, standing, absent). Postures are estimated from image analysis measured by thermal or depth cameras in order to preserve the anonymity of the person. The change in posture succession is calculated using the minimum edit distance with respect to the routine day. The number of permutations/inversions reflects the change in the person's behaviour. The method was tested on two elderly persons recorded by thermal and depth cameras during 85 days in a retirement home. It is shown that for a person with a life change behaviour, the average number of permutations and interquartile range, before and after changes, are 41 [28, 48] and 57 [55][56][57][58][59][60][61][62] respectively compared to the learned routine day. The Wilcoxon test confirmed the significant difference between these two periods.Clinical Relevance -Monitoring the daily routine provides indicators for detecting changes in the behaviour of an elderly person.

show abstract

Depth and thermal information fusion for head tracking using particle filter in a fall detection context

Cited by 16 publications

References 31 publications

Detection of changes in the behaviour of the elderly person

Detection of changes in the behaviour of the elderly person

3-D Refuse-Derived Fuel Particle Tracking-by-Detection Using a Plenoptic Camera System

Interest of the minimum edit distance to detect behaviour change of the elderly person

Contact Info

Product

Resources

About