Fast and robust video-based exercise classification via body pose tracking and scalable multivariate time series classifiers

Singh, Ashish; Bevilacqua, Antonio; Nguyen, Thach Le; Hu, Feiyan; McGuinness, Kevin; O’Reilly, Martin; Whelan, Darragh; Caulfield, Brian; Ifrim, Georgiana

doi:10.1007/s10618-022-00895-4

Cited by 12 publications

(2 citation statements)

References 56 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…BiLSTM consists of two separate hidden layers: the forward hidden layer (h f t ) and the backward hidden layer (h b t ). In the forward hidden layer h f t , the input vector x t is sequentially processed in ascending order, starting at 1 and moving up to T. In the backward hidden layer h b t , the input vector x t is processed in descending order, starting at T and moving down to (5)…”

Section: Bidirectional Lstmmentioning

confidence: 99%

“…Major multimedia platforms like Netflix, attracting millions of viewers in the entertainment industry, have propelled image and video processing to new heights in recent years. Additionally, various methodologies have been employed to analyze image content [2], including picture classification [3,4] and multivariate learning [5][6][7]. Furthermore, the attention mechanism in deep learning is crucial for video analysis due to the higher complexity and greater diversity inherent in videos [8].…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Enhancing multimedia management: cloud-based movie type recognition with hybrid deep learning architecture

Lin,

Yuan,

Chen

et al. 2024

J Cloud Comp

View full text Add to dashboard Cite

Film and movie genres play a pivotal role in captivating relevant audiences across interactive multimedia platforms. With a focus on entertainment, streaming providers are increasingly prioritizing the automatic generation of movie genres within cloud-based media services. In service management, the integration of a hybrid convolutional network proves to be instrumental in effectively distinguishing between a diverse array of video genres. This classification process not only facilitates more refined recommendations and content filtering but also enables targeted advertising. Furthermore, given the frequent amalgamation of components from various genres in cinema, there arises a need for social media networks to incorporate real-time video classification mechanisms for accurate genre identification. In this study, we propose a novel architecture leveraging deep learning techniques for the detection and classification of genres in video films. Our approach entails the utilization of a bidirectional long- and short-term memory (BiLSTM) network, augmented with video descriptors extracted from EfficientNet-B7, an ImageNet pre-trained convolutional neural network (CNN) model. By employing BiLSTM, the network acquires robust video representations and proficiently categorizes movies into multiple genres. Evaluation on the LMTD dataset demonstrates the substantial improvement in the performance of the movie genre classifier system achieved by our proposed architecture. Notably, our approach achieves both computational efficiency and precision, outperforming even the most sophisticated models. Experimental results reveal that EfficientNet-BiLSTM achieves a precision rate of 93.5%. Furthermore, our proposed architecture attains state-of-the-art performance, as evidenced by its F1 score of 0.9012.

show abstract

Section: Bidirectional Lstmmentioning

confidence: 99%