1Spring 2008Spring 2008CAP6938 CAP6938 ––3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Designing 3D User InterfacesDesigning 3D User InterfacesLecture Lecture #12:#12:3DUI Design3DUI DesignSpring 2008Spring 2008Joseph J. LaViola Jr.Joseph J. LaViola Jr.CAP6938 CAP6938 ––3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 2008Thus farThus far……3DUI hardware3DUI hardwareinputinputoutputoutputUniversal 3DUI tasksUniversal 3DUI tasksnavigationnavigationselection and manipulationselection and manipulationsystem controlsystem controlsymbolic inputsymbolic inputSimple combination of techniques and devices Simple combination of techniques and devices does not guarantee enjoyable experiencedoes not guarantee enjoyable experience2CAP6938 CAP6938 ––3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 20083DUI Design3DUI DesignMicrolevelMicroleveldevils in the detailsdevils in the detailscorrect implementationcorrect implementationcareful choice of parameterscareful choice of parametersMacrolevelMacrolevelstrengths and limitations of human strengths and limitations of human psychology/physiologypsychology/physiologycommon sensecommon senserules of thumbrules of thumbTwo main strategiesTwo main strategiesdesigning for humansdesigning for humansinventing 3DUIsinventing 3DUIsCAP6938 CAP6938 ––3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 2008Designing for Humans Designing for Humans ----FeedbackFeedbackFeedback is critical to usable 3D interfacesFeedback is critical to usable 3D interfacesany information conveyed to the user on to any information conveyed to the user on to help understand help understand the system statethe system stateresult of operationresult of operationstatus of taskstatus of taskFeedback control mechanismFeedback control mechanismWant to have appropriate feedback levelsWant to have appropriate feedback levelsEnsure complianceEnsure compliance3CAP6938 CAP6938 ––3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 2008Designing for Humans Designing for Humans ––Feedback Feedback in Multiple Dimensionsin Multiple DimensionsSensory dimensionsSensory dimensionsvisual, auditory, tactile, olfactoryvisual, auditory, tactile, olfactoryproprioceptiveproprioceptive, kinesthetic, kinestheticWant to try to give multiWant to try to give multi--dimensional feedbackdimensional feedbackcan be difficult due to technology (e.g., can be difficult due to technology (e.g., hapticshaptics))sensory feedback substitutionsensory feedback substitutionSystemSystem--based feedbackbased feedbackReactive Reactive ––combines sensory dimensions with UIcombines sensory dimensions with UIInstrumental Instrumental ––generated by controls and toolsgenerated by controls and toolsOperational Operational ––results from user actions results from user actions CAP6938 CAP6938 ––3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 2008Designing for Humans Designing for Humans ––ComplianceComplianceMain principle in design feedbackMain principle in design feedbackWant to different feedback dimensions in Want to different feedback dimensions in syncsyncmaintain spatial and temporal correspondence maintain spatial and temporal correspondence between multiple feedback dimensionsbetween multiple feedback dimensionsFeedback displacement Feedback displacement ––BAD!!!BAD!!!4CAP6938 CAP6938 ––3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 2008Designing for Humans Designing for Humans ––Spatial Spatial ComplianceComplianceDirectional compliance Directional compliance ––virtual object should virtual object should move in the same direction as manipulated by move in the same direction as manipulated by input deviceinput deviceallows anticipatory preparationallows anticipatory preparationNullingNullingcompliance compliance ––when user returns device when user returns device to initial pose, virtual object returns to to initial pose, virtual object returns to corresponding initial posecorresponding initial posehelps with muscle memoryhelps with muscle memoryInstrumental and operational feedback also Instrumental and operational feedback also require spatial compliance require spatial compliance CAP6938 CAP6938 ––3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 2008Designing for Humans Designing for Humans ––Temporal Temporal ComplianceComplianceLatency Latency ––typical problemtypical problemtemporal delay between user input and sensory temporal delay between user input and sensory feedbackfeedbackincompliance with internal feedbackincompliance with internal feedbackVariable latency can be even more problematicVariable latency can be even more problematicSolutions?Solutions?reduce scene complexityreduce scene complexityfaster hardwarefaster hardwarepredictive tracking predictive tracking5CAP6938 CAP6938 ––3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 2008Designing for Humans