3D Multi Person Tracking With Dual 360° Cameras

Shere, Matthew; Kim, Han Sung; Hilton, Adrian

doi:10.1109/icip40778.2020.9191269

Cited by 3 publications

(1 citation statement)

References 16 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…However, all of them are limited to the image space and so the applicability in robotics applications remains unexplored. Recent studies used a couple of calibrated omnidirectional cameras to achieve accurate 3D people tracking in panoramic videos [25]. The proposal of Yang et al [26], called Multi-person Panoramic Localization and Tracking (MPLT), instead relies on four calibrated perspective cameras, positioned such that they cover a field of view of 360 • to simulate an omnidirectional camera.…”

Section: People Trackingmentioning

confidence: 99%

People Tracking in Panoramic Video for Guiding Robots

Bacchin¹,

Berno²,

Menegatti³

et al. 2022

Preprint

View full text Add to dashboard Cite

A guiding robot aims to effectively bring people to and from specific places within environments that are possibly unknown to them. During this operation the robot should be able to detect and track the accompanied person, trying never to lose sight of her/him. A solution to minimize this event is to use an omnidirectional camera: its 360 • Field of View (FoV) guarantees that any framed object cannot leave the FoV if not occluded or very far from the sensor. However, the acquired panoramic videos introduce new challenges in perception tasks such as people detection and tracking, including the large size of the images to be processed, the distortion effects introduced by the cylindrical projection and the periodic nature of panoramic images. In this paper, we propose a set of targeted methods that allow to effectively adapt to panoramic videos a standard people detection and tracking pipeline originally designed for perspective cameras. Our methods have been implemented and tested inside a deep learning-based people detection and tracking framework with a commercial 360 • camera. Experiments performed on datasets specifically acquired for guiding robot applications and on a real service robot show the effectiveness of the proposed approach over other state-of-the-art systems. We release with this paper the acquired and annotated datasets and the open-source implementation of our method.

show abstract

Section: People Trackingmentioning

confidence: 99%