Bimodal Features Depth maps and 3D Skeleton Information with Time Sequence for HAR
Abstract
Over the past few decades, as software, hardware, and big data of computers improve by leaps and bounds, deep learning has been applied in all aspects of artificial intelligence in the real world, such as detection, segmentation and classification. The traditional methodology is to design a hand-crafted feature descriptor to represent an object for human activity recognition. The deep learning-based approaches directly extract features map based on the neural network processing. Compared with RGB video, depth sequences are more advantageous in lighting changes and information collection. In this work, we study depth maps based on deep learning and corresponding skeleton joint information. The 3D Convolutional Neural Network (CNN) directly learns spatial-temporal feature maps from depth map sequences. We extract the skeleton joints information where skeleton joints point distance, angle information and time sequences of skeleton joints point changes in different frames to classify human activities with the spatial-temporal feature map. We validate the hybrid feature vector with the Support Vector Machines (SVM) classifier on the MSR-Action3D and the UTKinect-Action3D benchmark datasets. Our proposed method proves that it has very promising classification accuracy compared with the current experiment result.
Keywords
Full Text:
PDFDisclaimer/Regarding indexing issue:
We have provided the online access of all issues and papers to the indexing agencies (as given on journal web site). It’s depend on indexing agencies when, how and what manner they can index or not. Hence, we like to inform that on the basis of earlier indexing, we can’t predict the today or future indexing policy of third party (i.e. indexing agencies) as they have right to discontinue any journal at any time without prior information to the journal. So, please neither sends any question nor expects any answer from us on the behalf of third party i.e. indexing agencies.Hence, we will not issue any certificate or letter for indexing issue. Our role is just to provide the online access to them. So we do properly this and one can visit indexing agencies website to get the authentic information. Also: DOI is paid service which provided by a third party. We never mentioned that we go for this for our any journal. However, journal have no objection if author go directly for this paid DOI service.