首页    期刊浏览 2022年12月02日 星期五
登录注册

文章基本信息

  • 标题:Dynamic Hand Gesture Recognition Using Multi-direction 3D Convolutional Neural Networks
  • 本地全文:下载
  • 作者:Jie Li ; Mingqiang Yang ; Yupeng Liu
  • 期刊名称:Engineering Letters
  • 印刷版ISSN:1816-093X
  • 电子版ISSN:1816-0948
  • 出版年度:2019
  • 卷号:27
  • 期号:3
  • 页码:490-500
  • 出版社:Newswood Ltd
  • 摘要:The static hand gesture recognition under simpleor complex background has become mature, but the dynamichand gesture recognition against simple background is stillchallenging. The reason is that we need pay attention to notonly spatial features but also temporal features in dynamichand gesture recognition. In this paper, we mainly researchthe drivers’ dynamic hand gesture recognition applied inautomotive users interfaces to ensure the safe and improve thecomfort. We use 3D convolutional neural networks(3DCNN) toclassify the dynamic hand gesture, which can effectively extracttemporal-spatial features. Our contributions have three aspects:1)We extract the key frames from the origin video by computingthe optical flow of two adjacent frames; 2)We propose anew data augmentation method–data temporal cropping, whichcan improve the recognition accuracy and prevent overfittingeffectively. 3)We propose a novel multi-direction convolutionalneural networks(mdCNN), which can extract the distinguishedtemporal-spatial features from the short videos. In the end, wepresent experiment results based on VIVA dataset and achieverecognition accuracy of 65.35%, which is higher than othermethods.
  • 关键词:Hand gesture recognition; Temporal-Spatial;features; Automotive users interfaces; 3D convolutional neural;networks
国家哲学社会科学文献中心版权所有