Predicting Social Interactions for Visual Tracking

Abstract

Human interaction dynamics are known to play an important role in the development of robust pedestrian trackers that are applicable to a variety of applications in video surveillance. Traditional approaches to pedestrian tracking assume that each pedestrian walks independently and the tracker predicts the location based on an underlying motion model, such as a constant velocity or autoregressive model. Recent approaches have begun to leverage interaction, especially by modeling the repulsion force, among pedestrians to improve motion predictions. However, human interaction is more complex and is influenced by both repulsion and attraction effects. This motivates the use of a more complex human interaction model for pedestrian tracking. In this paper, we propose a novel visual tracking method by leveraging complex social interactions. We present an algorithm that decomposes social interactions into multiple potential interaction modes. We integrate these multiple social interaction modes into an interactive Markov Chain Monte Carlo tracker. We demonstrate how the developed method translates into a more informed motion prediction, resulting in a robust tracking performance. We test our method on videos from unconstrained outdoor environments and compare it against popular multi-object trackers.

What Do I See? Modeling Human Visual Perception for Multi-person Tracking

“…Choi et al [14] considered the group motion dynamics within a joint prediction model. Yan et al [39] integrated the social attraction and repulsion effects into an interactive tracking framework. Qin et al [31] and Bazzani et al [5] exploited the social group effect associated with the tracking performance.…”

“…The computer vision community has begun to explore social behavior modeling to improve accuracy of multi-target tracking systems in recent years. Various social behavior models [29,24,39,31] have been explored and incorporated into the multi-person tracking frameworks. Unlike the traditional motion model, the social behavior model, in essence, treats human motion as the result of both a person's intention and their interaction with environment rather than the outcome of a motion dynamics model alone.…”