HUMAN GAIT ANALYSIS USING HYBRID CONVOLUTIONAL NEURAL NETWORKS

Abstract

  Human gait analysis is a promising method of researching on human activities like walking or sitting. It reflects the habits of one person and can be observed in any activity that person performs. The patterns in human movements are influenced by many factors, including physiology, social, psychological, and health factors. Differences in limb movements help identify gait patterns, which are often measured using inertial measurement unit sensors (IMU) like gyroscopes and accelerometers placed in various locations throughout the body.    This paper analyses the combination of IMU sensors and electromyography sensors (EMG) to improve the identification accuracy of human movements. We propose the hybrid convolutional neural network (CNN) and long short-term memory neuron network (LSTM) for the human gait analysis problem to achieve an accuracy of 0.9418, better than other models including pure CNN models. By using CNN's image classification advancements, we analyse multivariate time series sensor signals by using a sliding window to transform sensor data into image representation and principal component analysis (PCA) to reduce the data dimensionality. To tackle the dataset imbalance issue, we re-weight our model loss by the inverse effective number of samples in each class. We use the human gait HuGaDB dataset with unique characteristics, for gait analysis.