Journal of South China University of Technology (Natural Science Edition) ›› 2016, Vol. 44 ›› Issue (1): 78-84.doi: 10.3969/j.issn.1000-565X.2016.01.012

• Mechanical Engineering • Previous Articles     Next Articles

A Hierarchical Method of Interaction Hand Gesture for Virtual Assembly

XIONG Wei WANG Qing-hui LI Jing-rong   

  1. School of Mechanical and Automotive Engineering,South China University of Technology,Guangzhou 510640,Guangdong,China
  • Received:2015-08-24 Revised:2015-10-13 Online:2016-01-25 Published:2015-12-09
  • Contact: 熊巍( 1979-) ,男,博士生,讲师,主要从事人机交互技术研究. E-mail:weixiong@scut.edu.cn
  • About author:熊巍( 1979-) ,男,博士生,讲师,主要从事人机交互技术研究.
  • Supported by:
    Supported by the National Natural Science Foundation of China( 51275177)

Abstract: In this paper,by introducing a gesture recognition technology into the human computer interaction in virtual assembly,a hierarchical interaction hand gesture model is proposed to improve the user experience in virtual assembly tasks.According to the characteristics of assembly tasks and interactive modes,a two-level gesture recognition strategy is designed.In the strategy,firstly,interaction hand gestures are preliminarily classified,and the types of the hand gestures are identified on the basis of context-awareness.Next,a gesture semantic is recognized by capturing the motion features of hand.Then,different interaction modes are integrated seamlessly by estimating the functional region of hand workspace,and thus,users' difficulty in recognition is reduced.Experiment results show that the proposed model and recognition method can effectively improve both the human computer interaction efficiency and the user experience in a virtual assembly prototype system.

Key words: virtual assembly, human computer interaction, interaction hand gesture, scene navigation

CLC Number: