虚拟现实中的人机交互

–––––––••GUIPC•3DInterface(VR):DouglasC.EngelbartFirstmouseinvented()•–––3D––MyronKrueger(1991):….Theterm(virtualworlds)typicallyreferstothree-dimensionalrealitiesimplementedwithstereoviewinggogglesandrealitygloves.MyronKruegerIn1989,JaronLanier(1)GeorgeCoates(1992):VirtualRealityiselectronicsimulationsofenvironmentsexperiencedviaheadmountedeyegogglesandwiredclothingenablingtheendusertointeractinrealisticthree-dimensionalsituations.P.Greenbaum(1992):VirtualRealityisanalternateworldfilledwithcomputer-generatedimagesthatrespondtohumanmovements.•(Cyberspace)–•(.)•Realineffect;notrealinfact–,(2)()‘’AICGCHI”()(3)•:–“”()-----–/()–()–(4)()1956Sensorama(MortonHeilig)3Dvisuals,vibration,stereosound,wind,smell,littleinteraction.1961HeadsightSystem(PhilcoCorp.)HeadMountedDisplay(HMD),headtracking,remotevideocamera,telepresence.1965TheUltimateDisplay(IvanSutherland)StereoscopicHMD,computergeneratedimages,tracking,visuallycoupledsystem.1967Grope(UniversityofNorthCarolina)6degreeoffreedomforcefeedback.1977TheSayreGlove(Sandin,Sayre,DeFantiUniv.Illinois)Gesturerecognition.1987VirtualCockpit(BritishAerospace)headandhandtracking,eyetracking,3dvisuals,3Daudio,speechrecognition,vibrotactilefeedback.•(MixedReality)•NPSNETMUD()(MixedReality)MixedReality(MR)RealEnvironmentVirtualEnvironmentAugmentedReality(AR)AugmentedVirtuality(AV)()DistributedVirtualEnvironment)•:NetworkedVE(VR),SharedVE(VR),Multi-UserVE,etc.()•(DesktopVR)–(Stereoscopitic)•(ImmersiveVR)–•••(DistributedVR)–VR()()()•(visibility,audibility,touch,smell)•(quality,fidelity)()•(updaterates,timelag)•(text,speech,gestures,gaze,complexbehaviorpatterns)()•Immersion:•Interaction:CAD•Imagination:,(-3I)•:–()--()--()()-•–--–--•,–,,,(visibility)(awareness)(accountability)()–(visibility)–(awareness)–(accountability)()•VR•VR(Immersive)(Multi-Sensory)•()()••••••••••()••()•()•••VR••()••3D•••()••1.2.;3.4.;5.•()•20•••()()••••PC/•“”•GOMS(???)(???)GOMSWIMPPCGOMS•(MHP)ModelHumanProcessor•GOMS(StuartCardTomMoranAllenNewell1983)•WIMPMHP----GOMS-----WIMPDesktopGOMS(App.(App.ProgProg.).)•GOMS•Goals•Operators•Methods()•SelectionRulesGOMSGOAL:CLOSE-WINDOW.[selectGOAL:USE-MENU-METHOD.MOVE-MOUSE-TO-FILE-MENU.PULL-DOWN-FILE-MENU.CLICK-OVER-CLOSE-OPTIONGOAL:USE-CTRL-W-METHOD.PRESS-CONTROL-W-KEYS]:Rule1:SelectUSE-MENU-METHODunlessanotherruleappliesRule2:IftheapplicationisGAME,selectCTRL-W-METHODoperatorGOMS•–•–•–VR•GOMS––:–-()()„„„„•GOMS–Goals–Operations–Modals–Synergy•f(A,C,E,L)–Attention–Cognitiveload–Effectivenessofinteraction–Learnability:•––Simon–Simon–•––eGOMS•––•––•––•–Affordance3D•–visualdisplays–auditoryoutput–tactileandhapticoutput•–discreteeventdevices–continuouseventdevices–combinationdevices–speechinput•–headmounteddisplay(HMD):manyHMDs•–armmounteddisplay:BOOM–surroundscreenvirtualenvironment:CAVE•–projection-based:ImmersaDesk,WorkBench…–stereomonitor:useshutterglasses•–:“”(beep)–iconic:–:•–•–/•–:Phantom–:CyberGrasp–:CyberTouch•–––•––•keyboard,pinchglove•–•–:,,,,/,–••–•//–,,,,ringmouse,flymouse,BAT,Wand,FlexandPinch…–••–•:•:–•••VRVR•(Viewpoint)•(Navigation)•(Manipulation)•(Immersion)•/(Selection/Manipulation)(Navigation)(SystemControl)•//•–––•–,()•–,,,•Way-Finding–•Travel•–way-finding:–travel:,…–•()•walkthrough––•trackballexplodedview––()•Steering:–––(steeringwheel,flightsticks)•–,•–Mine,1995[P-40]••••––••3D••3D•3DUI3DUI•–––••“”•UI•3DWM3D3D2D•MicrosoftTaskGalleryWorkbench-basedRoom-based•ACMCHI2005WorkshoponFutureUserInterfaceToolkits–TangibleUserInterface–Camera-basedUserinterface–HapticUserInterface•“”ACMCHI2005WorkshoponFutureUserInterfaceToolkit]WIMPGUI•WIMP•/•WIMP•WIMP–Non-WIMP[MarkGreenetal,SIGGRAPH’1991]–Post-WIMP[VanDam,COMMUNICATIONSOFTHEACM1997]–WIMP•PIBG(PhysicalObjectIconButtonGesture)WIMPPIBG(Post–WIMP)PG(Non-WIMP)WPPIIMBPGG50%20%50%80%100%•?•?•?()•?(…..)•?•?