TWO-STREAM CONVOLUTIONAL NETWORK FOR DYNAMIC HAND GESTURE RECOGNITION USING CONVOLUTIONAL LONG SHORT-TERM MEMORY NETWORKS

Authors

  • Phat Huu Nguyen Hanoi University of Science and Technology
  • Tien Ngoc Luong

DOI:

https://doi.org/10.15625/2525-2518/58/4/14742

Keywords:

two stream-convnet, RNN- Recurrent neural network, spatial stream, temporal stream, dynamic hand gesture recognition, optical flow

Abstract

Human action and gesture recognition provides important and worth information for interaction between human and device ambient that monitors living, healthcare facilities or entertainment activities in smart homes. Recent years, there were many machine learning model application studies to recognize human action and gesture. In this paper, we propose a dynamic hand gesture recognition system in video based on two stream-convolution network (ConvNet) architecture. Specifically, we research the state-of-the-art approaches using to recognize dynamic hand gesture in video and propose an improvement method to enhance performance of model which is suitable for uses such as indoor environment in this paper. Our contribution is improvement of two stream ConvNet to achieve better performance. The results show that the proposal model improves execution speed and memory resource usage comparing to existing models.

Downloads

Download data is not yet available.

Author Biography

Phat Huu Nguyen, Hanoi University of Science and Technology

Phat Nguyen Huu received his B.E. (2003) and M.S. (2005) degrees in Electronics and Telecommunications from Hanoi University of Technology, Vietnam. His current interests in-
clude digital image processing and wireless sensor network. Currently, he is doing his research as a doctoral student at the Graduate School of Engineering and Science, Shibaura Institute of Technology, Japan. He is also a student member
of IEEE.

Downloads

Published

2020-07-13

Issue

Section

Electronics - Telecommunication