mailto:uumlib@uum.edu.my 24x7 Service; AnyTime; AnyWhere

Human activity detection and action recognition in videos using convolutional neural networks

Basavaiah, Jagadeesh and Patil, Chandrashekar Mohan (2020) Human activity detection and action recognition in videos using convolutional neural networks. Journal of Information and Communication Technology (JICT), 19 (2). pp. 157-183. ISSN 1675-414X

[thumbnail of JICT  19 2 2020 157-183.pdf] PDF
Restricted to Repository staff only

Download (2MB) | Request a copy

Abstract

Human activity recognition from video scenes has become a significant area of research in the field of computer vision applications. Action recognition is one of the most challenging problems in the area of video analysis and it finds applications in human-computer interaction, anomalous activity detection, crowd monitoring and patient monitoring. Several approaches have been presented for human activity recognition using machine learning techniques. The main aim of this work is to detect and track human activity, and classify actions for two publicly available video databases. In this work, a novel approach of feature extraction from video sequence by combining Scale Invariant Feature Transform and optical flow computation are used where shape, gradient and orientation features are also incorporated for robust feature formulation. Tracking of human activity in the video is implemented using the Gaussian Mixture Model. Convolutional Neural Network based classification approach is used for database training and testing purposes. The activity recognition performance is evaluated for two public datasets namely Weizmann dataset and Kungliga Tekniska Hogskolan dataset with action recognition accuracy of 98.43% and 94.96%, respectively. Experimental and comparative studies have shown that the proposed approach outperformed state-of the art techniques.

Item Type: Article
Uncontrolled Keywords: Action recognition, convolutional neural network, Gaussian Mixture Model, optical flow, SIFT feature extractio
Subjects: Q Science > QA Mathematics > QA76 Computer software
Divisions: School of Computing
Depositing User: Mrs. Norazmilah Yaakub
Date Deposited: 20 Apr 2020 05:11
Last Modified: 20 Apr 2020 05:11
URI: https://repo.uum.edu.my/id/eprint/26940

Actions (login required)

View Item View Item