[1]吴 秦,陈 智,周宇旋,等.基于Kinect骨骼跟踪技术的人机交互[J].常州大学学报(自然科学版),2014,(03):6-12.[doi:10.3969/j.issn.2095-0411.2014.03.002]
　WU Qin,CHEN Zhi,ZHOU Yu-xuan,et al.HumanComputer Interaction Based on Kinect SkeletalTracking[J].Journal of Changzhou University(Natural Science Edition),2014,(03):6-12.[doi:10.3969/j.issn.2095-0411.2014.03.002]
点击复制

基于Kinect骨骼跟踪技术的人机交互()
分享到：

常州大学学报(自然科学版)[ISSN:2095-0411/CN:32-1822/N]

卷:
期数:
2014年03期
页码:
6-12
栏目:
计算机与信息工程
出版日期:
2014-06-30

文章信息/Info

Title:
HumanComputer Interaction Based on Kinect SkeletalTracking
作者:
吴 秦; 陈 智; 周宇旋; 梁久祯
江南大学 物联网工程学院,江苏 无锡 214122
Author(s):
WU Qin; CHEN Zhi; ZHOU Yu-xuan; LIANG Jiu-zhen
School of Internet of Things Engineering,Jiangnan University,Wuxi 214122,China
关键词:
人机交互;  Kinect;  骨骼跟踪;  人体坐标;  延迟帧;  手势操控
Keywords:
humancomputer interaction;  Kinect;  skeletaltracking;  humanbased coordinate;  delayed frame;  hand gesture control
分类号:
TP 391
DOI:
10.3969/j.issn.2095-0411.2014.03.002
文献标志码:
A
摘要:
基于Kinect提供的深度信息和骨骼跟踪技术进行手势识别,利用手势代替鼠标实现人机交互。首先,引入以人体为参考系的人体坐标系统,将手势位置通过坐标系变换映射到计算机屏幕,实现计算机屏幕上光标的位置显示和跟踪。其次,研究计算机操作系统响应鼠标事件的工作模式,设计固定的手势静态及动态工作模式,通过一定的映射关系将特定的一组手势与计算机系统基本操作指令进行对应。并定义状态机,根据手势状态触发系统操作事件,从而达到对计算机系统的体感控制。实验表明,该人机交互系统自然、合理、有效。
Abstract:
The depth information and skeletal tracking provided by Kinect can be used for hand gesture recognition. A new humancomputerinteraction method is proposed by replacing mouse operations with hand gestures.Firstly,to display the location of the cursor and tracking it accurately on thecomputer screen,a humanbased coordinate system is introduced andhand gestures are mapped to the computer screen by coordinate transformation.Secondly,the response mode of the computer operating system to mouse events is studied.The fixed modes of static and dynamic hand gestures are designed.A mappingbetween a specific set of hand gestures and computer responds to basic system controls are defined. And a state machine is described to trigger system events based on hand gestures.Experiments show that the proposed human–computer interaction system based on hand gestures is natural,reasonable and effective.

参考文献/References:

[1]Stuart K Card,Moran Thomas P,Newell Allen.The keystroke-level model for user performance time with interactive systems[J].Communications of theACM,1980,23(7):396-410.
[2]James H Carlisle.Evaluating the impact of office automation on top management communication[C]∥The National Computer Conference and Exposition.New York: ACM,1976:611-616.
[3]Alejandro Jaimesa,Nicu Sebeb.Multimodal human-computer interaction:A survey[J].Computer Vision and Image Understanding,2007,108(1):116-134.
[4]Daniel Wigdor,Dennis Wixon.自然用户界面设计:NUI的经验教训与设计原则[M].季罡,译.北京:人民邮电出版社,2012.
[5]Meenakshi Gupta,Shruti Sharma.Virtual Class room using six sense technology[J].IOSR Journal of Computer Engineering,2012,6(4):20-25.
[6]于涛.Kinect应用开发实战:用最自然的方式与机器对话[M].北京:机械工程出版社,2013.
[7]Matthew Tan.Recognizing Hand Gestures with Microsoft's Kinect[R].California:[s.n.],2011.
[8]Kam Lai,Konrad J,Ishwar P.A gesture-driven computer interface using Kinect[C]∥Image Analysis and Interpretation(SSIAI).Boston:IEEE,2012:185-188.
[9]曾繁江,李涛,黎铭.Kinect平台上使用机器学习的非接触式GUI操控方式[J].计算机科学与探索,2014,8(2):171-178.
[10]Ivan Tashev.Kinect Development kit:A toolkit for gesture and speech-basedhuman-machine interaction[J].IEEE Signal Process Mag,2013,30(5):129-131.
[11]Juergen Gall,Carsten Stoll,Edilson de Aguiar,et al.Motion capture usingjoint skeleton tracking and surface estimation[C]∥IEEE Conference on Computer Vision and Pattern Recognition.Miami:IEEE,2009:1746-1753.
[12]Lu Xia,Chia-Chih Chen,Aggarwal J K.Human detection using depth information by Kinect[C]∥Computer Vision and Pattern Recognition Workshops(CVPRW).Colorado Springs:IEEE,2011.
[13]Maged N Kamel Boulos,Bryan J Blanchard,Cory Walker,et al.Web GIS in practice X:a microsoft Kinect natural user interface for Google Earth navigation[J].International Journal of Health Geographics,2011,10:45.
[14]Peter Henry,Michael Krainin,Evan Herbst,et al.RGB-D mapping: Using Kinect-style depth cameras for dense 3D modeling of indoor environments[J].I JRobotic Res,2012,31(5):647-663.
[15]Ilonen J.Three-dimensional object reconstruction of symmetric objects byfusing visual and tactile sensing[J].The International Journal of Robotics Research,2014,33:321-341.
[16]Yao-Jen Chang,Shu-Fang Chen,Jun-Da Huang.A Kinect-based system for physical rehabilitation:A pilot study for young adults with motor disabilities[J].Research in Developmental Disabilities,2011,32(6):2566-2570.
[17]Belinda Lange,Sebastian Koenig,Eric McConnell,et al.Interactive game-based rehabilitation using the Microsoft Kinect[C]∥Virtual Reality Short Papers and Posters(VRW).Costa Mesa:IEEE,2012,171-172.
[18]Danilo Avola,Luigi Cinque,Stefano Levialdi,et al.Human body language analysis:A preliminary study based on Kinect skeleton tracking[J].New Trends inImage Analysis and Processing.ICIAP 2013,Lecture Notes in Computer Science,2013,8158:465-473.

备注/Memo

备注/Memo:
基金项目:国家自然科学基金项目资助(61202312); 教育部留学回国人员科研启动基金资助。 作者简介:吴秦(1978-),女,江苏宜兴人,博士,副教授,主要从事计算机视觉、模式识别研究。Email:qinwu@jiangnan.edu.cn
更新日期/Last Update: 2014-06-30