Two-stream convolutional network for dynamic hand gesture recognition using convolutional long short-term memory networks

Authors

  • Phat Nguyen Huu School of Electronics and Telecommunications, Hanoi University of Science and Technology, 1 Dai Co Viet, Hai Ba Trung, Ha Noi, Viet Nam
  • Tien Luong Ngoc School of Electronics and Telecommunications, Hanoi University of Science and Technology, 1 Dai Co Viet, Hai Ba Trung, Ha Noi, Viet Nam

DOI:

https://doi.org/10.15625/2525-2518/58/4/14742

Keywords:

two stream-convnet, RNN- Recurrent neural network, spatial stream, temporal stream, dynamic hand gesture recognition, optical flow

Abstract

Human action and gesture recognition provides important and worth information for interaction between human and device ambient that monitors living, healthcare facilities or entertainment activities in smart homes. Recent years, there were many machine learning model application studies to recognize human action and gesture. In this paper, we propose a dynamic hand gesture recognition system in video based on two stream-convolution network (ConvNet) architecture. Specifically, we research the state-of-the-art approaches using to recognize dynamic hand gesture in video and propose an improvement method to enhance performance of model which is suitable for uses such as indoor environment in this paper. Our contribution is improvement of two stream ConvNet to achieve better performance. The results show that the proposal model improves execution speed and memory resource usage comparing to existing models.

Downloads

Download data is not yet available.

Author Biography

Phat Nguyen Huu, School of Electronics and Telecommunications, Hanoi University of Science and Technology, 1 Dai Co Viet, Hai Ba Trung, Ha Noi, Viet Nam

1. Xử lý ảnh và video

2.Mạng cảm biến không dây

3.Mã sửa lỗi trước

4.Mạng M2M (machine-to-machine)

5.Mạng di động

6.Bảo mật hệ thống

Downloads

Published

2020-07-13

How to Cite

[1]
P. N. . Huu and T. . L. . Ngoc, “Two-stream convolutional network for dynamic hand gesture recognition using convolutional long short-term memory networks”, Vietnam J. Sci. Technol., vol. 58, no. 4, pp. 514–523, Jul. 2020.

Issue

Section

Electronics - Telecommunication