Learning joints relation graphs for video action recognition

Abstract

Previous video action recognition mainly focuses on extracting spatial and temporal features from videos or capturing physical dependencies among joints. The relation between joints is often ignored. Modeling the relation between joints is important for action recognition. Aiming at learning discriminative relation between joints, this paper proposes a joint spatial-temporal reasoning (JSTR) framework to recognize action from videos. For the spatial representation, a joints spatial relation graph is built to capture position relations between joints. For the temporal representation, temporal information of body joints is modeled by the intra-joint temporal relation graph. The spatial reasoning feature and the temporal reasoning feature are fused to recognize action from videos. The effectiveness of our method is demonstrated in three real-world video action recognition datasets. The experiment results display good performance across all of these datasets.

Short-Term Action Learning for Video Action Recognition

“…Video action recognition is one of the most challenging tasks in the field of computer vision [1][2][3][4][5][6][7][8][9][10]. The aim of video action recognition is to extract a large amount of action information from the raw video through effective spatio-temporal modeling techniques.…”