Enhanced Human Action Recognition Using Fusion of Skeletal Joint Dynamics and Structural Features

• Published in: Journal of robotics Vol. 2020; no. 2020; pp. 1 - 16
• Main Authors: Holla, Raghurama, Acharya, U. Dinesh, Muniyal, Balachandra, Muralikrishna, S. N.
• Format: Journal Article
• Language: English
• Published: Cairo, Egypt Hindawi Publishing Corporation 2020; Hindawi; Hindawi Limited
• Subjects: Algorithms; Automation; Cameras; Datasets; Deep learning; Human activity recognition; Human motion; Joints (anatomy); Neural networks; Pattern recognition; Sensors; Surveillance
• ISSN: 1687-9600; 1687-9619
• DOI: 10.1155/2020/3096858

In this research work, we propose a method for human action recognition based on the combination of structural and temporal features. The pose sequence in the video is considered to identify the action type. The structural variation features are obtained by detecting the angle made between the joints during the action, where the angle binning is performed using multiple thresholds. The displacement vector of joint locations is used to compute the temporal features. The structural variation features and the temporal variation features are fused using a neural network to perform action classification. We conducted the experiments on different categories of datasets, namely, KTH, UTKinect, and MSR Action3D datasets. The experimental results exhibit the superiority of the proposed method over some of the existing state-of-the-art techniques.