EgoReID: Cross-view Self-Identification and Human Re-identification in Egocentric and Surveillance Videos

Abstract

Human identification remains to be one of the challenging tasks in computer vision community due to drastic changes in visual features across different viewpoints, lighting conditions, occlusion, etc. Most of the literature has been focused on exploring human re-identification across viewpoints that are not too drastically different in nature. Cameras usually capture oblique or side views of humans, leaving room for a lot of geometric and visual reasoning. Given the recent popularity of egocentric and top-view vision, re-identification across these two drastically different views can now be explored. Having an egocentric and a top view video, our goal is to identify the cameraman in the content of the top-view video, and also re-identify the people visible in the egocentric video, by matching them to the identities present in the top-view video. We propose a CRF-based method to address the two problems. Our experimental results demonstrates the efficiency of the proposed approach over a variety of video recorded from two views.

Ego-Exo: Transferring Visual Representations from Third-person to First-person Videos

“…Viewpoint invariance has also been treated as a domain adaptation task in prior work, adapting third-person video models for overhead drone-footage [10]. Other methods use egocentric video as a modality to supplement top-view footage to improve identification and tracking models [2,4,5,73].…”