机械工程

面向虚拟装配的层次化交互手势技术

展开
  • 华南理工大学 机械与汽车工程学院,广东 广州 510640
熊巍( 1979-) ,男,博士生,讲师,主要从事人机交互技术研究.

收稿日期: 2015-08-24

  修回日期: 2015-10-13

  网络出版日期: 2015-12-09

基金资助

国家自然科学基金资助项目( 51275177) ; 华南理工大学中央高校基本科研业务费专项资金资助项目( 2014ZM0026)

A Hierarchical Method of Interaction Hand Gesture for Virtual Assembly

Expand
  • School of Mechanical and Automotive Engineering,South China University of Technology,Guangzhou 510640,Guangdong,China
熊巍( 1979-) ,男,博士生,讲师,主要从事人机交互技术研究.

Received date: 2015-08-24

  Revised date: 2015-10-13

  Online published: 2015-12-09

Supported by

Supported by the National Natural Science Foundation of China( 51275177)

摘要

针对目前虚拟装配系统存在的用户体验不足问题,文中将手势识别技术引入虚拟装配的人机交互中,提出了一种面向虚拟装配操作的层次化交互手势模型; 根据装配任务和交互模式的特点,提出了二级手势分类策略: 先对交互手势进行初步分类再利用情境感知技术判断手势的类型; 然后利用运动感知技术对手势的交互语义进行识别; 接着通过对用户作业空间的手功能区感知来实现不同交互模式的自然过渡,从而降低用户在交互过程中的认知负担; 最后通过自主开发的虚拟装配原型系统对文中提出的交互手势技术进行验证. 实验结果表明,文中的层次化交互手势建模与识别方法能有效地增加虚拟装配环境中的人机交互效率和用户体验.

本文引用格式

熊巍 王清辉 李静蓉 . 面向虚拟装配的层次化交互手势技术[J]. 华南理工大学学报(自然科学版), 2016 , 44(1) : 78 -84 . DOI: 10.3969/j.issn.1000-565X.2016.01.012

Abstract

In this paper,by introducing a gesture recognition technology into the human computer interaction in virtual assembly,a hierarchical interaction hand gesture model is proposed to improve the user experience in virtual assembly tasks.According to the characteristics of assembly tasks and interactive modes,a two-level gesture recognition strategy is designed.In the strategy,firstly,interaction hand gestures are preliminarily classified,and the types of the hand gestures are identified on the basis of context-awareness.Next,a gesture semantic is recognized by capturing the motion features of hand.Then,different interaction modes are integrated seamlessly by estimating the functional region of hand workspace,and thus,users' difficulty in recognition is reduced.Experiment results show that the proposed model and recognition method can effectively improve both the human computer interaction efficiency and the user experience in a virtual assembly prototype system.
文章导航

/