Multimodal spatial-temporal feature representation and its application in action recognition

Abstract

： Objective Human body motion-related recognition has been developing in the context of computer vision and pattern recognition like auxiliary human-computer interaction， motion analysis， intelligent monitoring， and virtual reality.To obtain two-dimensional information for its behavioral recognition， conventional motion behavior recognition is mainly used the RGB image sequence captured by RGB camera. To improve the ability to detect short-duration fragments， current feature descriptors for RGB image sequences are employed to characterize human behavior， such as histogram of oriented gradient (HOG)， histogram of optical flow (HOF)， and a three-dimensional feature pyramid. Some researchers are focused on the feature that image depth is insensitive to ambient light since RGB images are oriented to behavior image sequences of objects in terms of two-dimensional information. The depth information of the image is coordinated with the 中图法分类号： TP391文献标识码： A