Real-Time 3D Human Pose Estimation from Monocular View with Applications to Event Detection and Video Gaming

Ke, Shian-Ru; Zhu, Liangjia; Hwang, Jenq‐Neng; Pai, Hung‐I; Lan, Kung-Ming; Liao, Chih-Pin

doi:10.1109/avss.2010.80

Cited by 28 publications

(10 citation statements)

References 13 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Furthermore, Ke et al [69,70] propose a method to do body-part tracking by integrating skeleton, color and temporary information and estimate 3D human poses with a predefined 3D human model as shown in Figure 10 [70]. The proposed system can do real-time front-view 3D human pose estimation [69], and view-invariant 3D human pose estimation [70], which requires close to real-time computational cost.…”

Section: Direct Modelmentioning

confidence: 99%

“…The proposed system can do real-time front-view 3D human pose estimation [69], and view-invariant 3D human pose estimation [70], which requires close to real-time computational cost. The main drawback of the proposed systems is that it has limited capability to recover the human poses while tracking errors happen.…”

Section: Direct Modelmentioning

confidence: 99%

“…In the direct model scheme, a priori human model (i.e., the explicit 3D geometric representation of human space and kinematic structure) is directly used as the model, which represents the observed subject and is continuously updated by the observations [52,[64][65][66][67][68][69][70]. Sedai et al [52] use an HLAC image descriptor (as discussed in Section 3.3.6) for 3D human pose estimation from monocular video sequence (see a 3D human model shown in Figure 9 [52]).…”

Section: Direct Modelmentioning

confidence: 99%

“…However, the above mentioned feature representations do not fully capture the whole body actions. Therefore, some human modeling methods [15,39,52,[60][61][62][63][64][65][66][67][68][69][70] are also proposed to model the human body including simple blobs, 2D body modeling and 3D body modeling. Generally, the body modeling requires the 2D/3D pose estimation problem.…”

Section: Introductionmentioning

confidence: 99%

See 3 more Smart Citations

A Review on Video-Based Human Activity Recognition

et al. 2013

Self Cite

View full text Add to dashboard Cite

This review article surveys extensively the current progresses made toward video-based human activity recognition. Three aspects for human activity recognition are addressed including core technology, human activity recognition systems, and applications from low-level to high-level representation. In the core technology, three critical processing stages are thoroughly discussed mainly: human object segmentation, feature extraction and representation, activity detection and classification algorithms. In the human activity recognition systems, three main types are mentioned, including single person activity recognition, multiple people interaction and crowd behavior, and abnormal activity recognition. Finally the domains of applications are discussed in detail, specifically, on surveillance environments, entertainment environments and healthcare systems. Our survey, which aims to provide a comprehensive state-of-the-art review of the field, also addresses several challenges associated with these systems and applications. Moreover, in this survey, various applications are discussed in great detail, specifically, a survey on the applications in healthcare monitoring systems. OPEN ACCESSComputers 2013, 2 89

show abstract

Section: Direct Modelmentioning

confidence: 99%

Section: Direct Modelmentioning

confidence: 99%

Section: Direct Modelmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

A Review on Video-Based Human Activity Recognition

et al. 2013

Self Cite

View full text Add to dashboard Cite

show abstract

“…3D human poses are inferred based on a method of Data-Driven Markov Chain Monte Carlo [22]- [23]; however, the computation cost is extremely high. Considering accuracy of pose estimation and time complexity simultaneously, Ke and others [24]- [25] propose a method to track 2D body parts by integrating shape, color, and temporal information to effectively estimate 3D human poses.…”

Section: Introductionmentioning

confidence: 99%

Human Action Recognition Based on 3D Human Modeling and Cyclic HMMs

Thuc

Hwang

et al. 2014

ETRI J

Self Cite

View full text Add to dashboard Cite

Human action recognition is used in areas such as surveillance, entertainment, and healthcare. This paper proposes a system to recognize both single and continuous human actions from monocular video sequences, based on 3D human modeling and cyclic hidden Markov models (CHMMs). First, for each frame in a monocular video sequence, the 3D coordinates of joints belonging to a human object, through actions of multiple cycles, are extracted using 3D human modeling techniques. The 3D coordinates are then converted into a set of geometrical relational features (GRFs) for dimensionality reduction and discrimination increase. For further dimensionality reduction, k-means clustering is applied to the GRFs to generate clustered feature vectors. These vectors are used to train CHMMs separately for different types of actions, based on the Baum-Welch re-estimation algorithm. For recognition of continuous actions that are concatenated from several distinct types of actions, a designed graphical model is used to systematically concatenate different separately trained CHMMs. The experimental results show the effective performance of our proposed system in both single and continuous action recognition problems. Keywords I. IntroductionHuman action recognition is a growing topic in video analysis and understanding -one of the most popular areas in the community of computer vision -thanks to its applications in surveillance, entertainment, and healthcare. In surveillance, human action recognition can be used in conjunction with video camera footage to help with the recognition and analysis of human actions. In entertainment, human-computer interaction can be helped to appear more natural via human action recognition, which in turn can help increase the entertainment experience. In healthcare, human action recognition can help detect abnormal gaits or assist in a patient's rehabilitation through an analysis of their actions.However, it is challenging to recognize various human actions due to the high number of degrees of freedom associated with the average human body -namely, variations in human poses; variations in the colors of a person's clothing; changes in lighting and illumination; variations in viewpoints; and frequent self-occlusion. Moreover, the use of monocular video sequences further increases the difficulty for human action recognition.Generally, the two main stages in human action recognition are: the feature extraction and representation stage and the classification stage.In the feature extraction and representation stage, the features or characteristics of video frames, such as silhouette, shape, color, and motion, are extracted and represented in a systematic and efficient way. consists of stacking segmented silhouettes (frame by frame) to form a 3D spatial-temporal shape. In a similar way, Ke and others [2] build STVs, for shape-based matching, from image features that are based on the consecutive silhouettes of objects along a time axis, including spatial-temporal region extraction and region matching. Kim and oth...

show abstract