基于手势的人机交互的研究

12520009JOURNALOFSYSTEMSIMULATIONVol.12No.5September2000:1004-731X(2000)05-0528-06栗阳,关志伟,陈由迪,戴国忠(,;8718,100080;[e-mail]):2000-03-01:(No.863-306-03-01;No.863-511-942-012):(1974-),,,,,(1974-),,,,,CAD(1938-),,,,CAD,(1944-),,,,,,:人机交互的本质是人的多维信息认知空间和计算机的信息表示空间之间的相互映射传统的用户界面范型遵循着一种基于命令的交互,交互的输入输出是离散的事件流,交互中人的意图不能自然高效地表达,需要交互者较多的认知努力基于手势的人机交互以手势表达交互意图,手势中含有大量的交互信息,同时又符合人的认知习惯基于手势的交互具有非精确多通道连续等特点,能够实现人的认知空间和计算机计算空间之间的平滑过渡,从而有效地改善了人机交互的瓶颈现象基于笔的手势交互有很大的现实意义,对它的分析研究有助于推动计算机便携化的快速发展:认知模型;基于命令的交互;图形用户界面;基于手势的交互;笔式用户界面;混合自动机:TP33412+1:AResearchonGesture-basedHuman-ComputerInteractionLIYang,GUANZhi-wei,CHENYou-di,DAIGuo-zhong(IntelligentEngineeringLab,InstituteofSoftware,CAS,P.O.Box8718,Beijing100080China;[e-mail])Abstract:Theessenceofhuman-computerinteraction(HCI)isthemutualmappingbetweenthecognitivespaceofhumanandthecomputationspaceofcomputer.Traditionaluserinterfaceparadigmsconformtocommand-basedinteraction,whichtheinputandoutputisbasedonthestreamofdiscreteevents.Theusercannotnaturallyandefficientlyexpressinteractiveintentionandtheinteractiveinterfaceconsumesmuchcognitiveefforts.Gesture-basedinteractionemploysgesturestoex-pressinteractiveintention,whichcontainsplentyofinteractiveinformation.Itaccordswiththementalmodelofhumananditischaracterizedbymult-imodal,continuousandinaccurateattributes,whichcanfulfillthesmoothtransformationfromcognitivespacetocomputationspace.Consequently,itimprovesthebottleneckoftheHCI.Pen-basedgestureinteractionhasthegreatsignificanceofreality.Theresearchforitwillacceleratethedevelopmentoftheportablecomputers.Keywords:cognitivemodel;command-basedinteraction;graphicaluserinterface(GUI);gesture-basedinteraction;pen-baseduserinterface(PUI);hybridautomaton1,,,,,(GUI),/,,,,,,)))(Desktop-based),/0,,/0,,,(DataGlove),,,/0PC,(MobileComputing),/0,,,,,,,,,,WIMP(WindowsIconsMenusPointer),[1](Token-based),,,,,,,,,2,,,,,,))),,,,(),(),,/0/0,,/0/0,,1/0,1,,,,,,,,,()U-NIXVI(Visualedit),,,(DFA,DefiniteFiniteAutoma-tion)2VI:(command_state,)(edit_state)(command_line_state),VI(Esc,i),,WIMP(Window,Icon,Menu,Pointer)WIMP,,#529#125:2VI[5],,,,,,,,[6]WIMPMicrosoftWord,(),(Token-based),(),,,Word,,;,,,,Word,,,,,3,,,,,,,,,,,,,,,,(),,,,,,,[9],,3,3,,;,,;,,,,3.1,#530#20009,,,,,,,,,,,,,,,,,,,,,,,,,,(Compiler-based),WIMPBNF(Backus-NaurForm)ATN(Augment-edTransitionNetwork),,,(),(HybridAutomaton)[4],,,,,,,(),,44,,,fpen_pospen_pressurepen_ink;feedbackout_track;Intentioncontexttoken;change_contexttoken;sementic_feedbackdocumentdoc_display;gesture_recognizer,handwriting_recognizer,edit_docu-mentdocument,add_word,token=GESTURE,token=WORD,,,#531#125:,,,3.2EasyEditor,EasyEditor,PenBuilderEasyEditor,:##/05EasyEditor,5EasyEditor,,,,,5EasyEditor3.3,,,,,,,WIMP,,,,,,())))WIMP:,6,Move_words=select#cut#moveFocus#paste5,,,1,,,()64,,,,,,,,,,EasyEditor,:[1],,.[M].:,1999.[2]JacobRJK.ASoftwareModelandSpecificationLanguageforNon-WIMPUserInterfaces[J].ACMTransactionsonCom-#532#20009puter-HumanInteraction,1999March,6(1):1-46.[3]GreenM.SoftwareArchitecturesandMetaphorsforNon-WIMPUserInterfaces[J].ComputerGraphics,1991July,25(3):229-235.[4]AlurR.TheAlgorithmicAnalysisofHybridSystems[J].Theo-reticalComputerScience,1995,138:3-34.[5].[J].(),1997,27(5):369-374.[6]WassermanAI.ExtendingStateTransitionDiagramsfortheSpecificationofHuman-ComputerInteraction[J].IEEETransac-tionsonSoftwareEngineering,1985August,SE-11(8):699-713.[7]Myers.Userinterfacesoftwaretechnology[J].ACMComputerSurvey,1996March,28(1):189-191.[8]J™rgen.InteractiveTechniques[J].ACMComputerSurvey,1996March,28(1):185-187.[9]JacobRJK.Human-ComputerInteraction:InputDevices[J].ACMComputingSurveys,1996March,28(1):177-179.[10]AllanChristianLongJAC.ImprovingGesturesandInteractionTechniquesforPen-basedUserInterfaces[J].ACMCHI,1998April:58-59.(467),,,,,,,(),(),,,,,,,,,6VR-LinkVR-Link,VR-LinkPDU,PDU,,PDUVR-Link,8163264,,,VR-Link,,,VR-Link7DRDR:DR,:xi=x0+v#$t+0.5#a#$t2x0va,$tDR,:(1)tPDUH7,XxXyXz(2)ŠT1ŠT2ŠT3ŠT4=120Xx0Xy-Xz0XzXy-Xx0q1q2q3q4(3):c11=q21+q22-q23-q24c12=2#(q2#q3-q1#q3)c21=2#(q2#q3+q1#q4)c22=q23-q24+q21-q22c31=2#(q2#q4-q1#q3)c32=2#(q3#q4+q1#q2)c213=2#(q2#q4+q1#q3)c223=2#(q3#q4-q1#q2)c33=q24-q23-q22+q21Ht+$t=sin-1(-c42)5t+$t=tg-1c43c447t+$t=tg-1c32c22$t,DR8,VR-Link,:[1][R].,1996,11.[2].GPS[M].:,1997,7.#533#125: