A survey on infrared image &amp; video sets

Danaci, Kevser Irem; Akagündüz, Erdem

doi:10.1007/s11042-023-15327-8

Cited by 12 publications

(1 citation statement)

References 93 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…When it comes to visual tracking, combining multiple imaging modalities has shown potential in overcoming the limitations of single-modal tracking systems. In recent years, RGBT tracking studies have increased significantly due to the availability of all-in-one RGB and TIR optical systems [8]. In particular, deep learning-based RGBT architectures dominated the literature with the rise of deep learning.…”

Section: Related Workmentioning

confidence: 99%

EANet: enhanced attribute-based RGBT tracker network

Türkoğlu,

Akagunduz

2024

Sixteenth International Conference on Machine Vision (ICMV 2023)

View full text Add to dashboard Cite

Tracking objects can be a difficult task in computer vision, especially when faced with challenges such as occlusion, changes in lighting, and motion blur. Recent advances in deep learning have shown promise in challenging these conditions. However, most deep learning-based object trackers only use visible band (RGB) images. Thermal infrared electromagnetic waves (TIR) can provide additional information about an object, including its temperature, when faced with challenging conditions. We propose a deep learning-based image tracking approach that fuses RGB and thermal images (RGBT). The proposed model consists of two main components: a feature extractor and a tracker. The feature extractor encodes deep features from both the RGB and the TIR images. The tracker then uses these features to track the object using an enhanced attribute-based architecture. We propose a fusion of attribute-specific feature selection with an aggregation module. The proposed methods are evaluated on the RGBT234 [1] and LasHeR [2] datasets, which are the most widely used RGBT object-tracking datasets in the literature. The results show that the proposed system outperforms state-of-the-art RGBT object trackers on these datasets, with a relatively smaller number of parameters.

show abstract

Section: Related Workmentioning

confidence: 99%