1Spring 2008Spring 2008CAP6938 CAP6938 ––3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Games and 3D User Interfaces: Games and 3D User Interfaces: Past, Present, and FuturePast, Present, and FutureLecture #2: Games and 3DUI*Lecture #2: Games and 3DUI*Spring 2008Spring 2008Joseph J. LaViola Jr.Joseph J. LaViola Jr.*Special thanks to Ivan PoupyrevCAP6938 CAP6938 ––3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 20083DUI and Video Games 3DUI and Video Games ––Why?Why?Video gamesVideo gamesmultimulti--billion dollar industry: $10.5 billions in 2005 in USbillion dollar industry: $10.5 billions in 2005 in USmajor major driving force driving force in in home home entertainment: average gamer entertainment: average gamer today is 33 years oldtoday is 33 years oldadvanced advanced 3D graphics in HOME rather then universities3D graphics in HOME rather then universitiesorormovies studios movies studios Driving force in technological innovationDriving force in technological innovationgraphics algorithms and hardware, sound, AI, etc.graphics algorithms and hardware, sound, AI, etc.technological transfer to healthcare, biomedical researchtechnological transfer to healthcare, biomedical researchdefence, education (example: Folding@Home)defence, education (example: Folding@Home)Recent innovations in 3D user interfacesRecent innovations in 3D user interfacesgraphics is not enough anymoregraphics is not enough anymorecomplex spatial, 3D user interfaces are coming to homecomplex spatial, 3D user interfaces are coming to home(example: Nintendo Wii)(example: Nintendo Wii)Why 3D user interfaces for games?Why 3D user interfaces for games?natural motion and gesturesnatural motion and gesturesreduce complexityreduce complexitymore immersive and engagingmore immersive and engagingResearch in 3D UI for games is exitingResearch in 3D UI for games is exitingwill transfer 3DUI to other practical applications, e.g. educatiwill transfer 3DUI to other practical applications, e.g. educationonand medicineand medicine2CAP6938 CAP6938 ––3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 20083DUI and Video Games 3DUI and Video Games ––What?What?Goal of 3DUI in gamesGoal of 3DUI in gamesdesiging input devices and interaction techniques to desiging input devices and interaction techniques to effectively control highly dynamic 3D computer effectively control highly dynamic 3D computer generated contententgenerated contententthere are basic approachesthere are basic approachesMapping 2D input to interact with 3D worldMapping 2D input to interact with 3D worldkeyboard and mouse, joysticks, game controllerskeyboard and mouse, joysticks, game controllerstraditinal form of gaming user interfaces: traditinal form of gaming user interfaces: e.g. Flight Simulator, Second life, Halo 3e.g. Flight Simulator, Second life, Halo 3Simulating real world tools or using physicial propsSimulating real world tools or using physicial propssimulation: steering wheels, light guns, musical simulation: steering wheels, light guns, musical instrumentsinstrumentsphysical props: dance padsphysical props: dance padsTrue spatial tracking of user gesturesTrue spatial tracking of user gesturescamera, e.g. Sony Eyetoycamera, e.g. Sony Eyetoyacceleration/infrared tracking: Wii controllersacceleration/infrared tracking: Wii controllersThis talk focuses on last two interface solutionsThis talk focuses on last two interface solutionsCAP6938 CAP6938 ––3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 2008Lecture OutlineLecture OutlineHistorical PerspectivesHistorical Perspectivesearly consolesearly consolesarcades arcades early 3D/VR game interfacesearly 3D/VR game interfaces3DUI in the home today3DUI in the home todaynew generation of game UInew generation of game UIThe Future of UI in gamesThe Future of UI in gamesAR/VR/mobile gamesAR/VR/mobile gamesworking towards the futureworking towards the futureConclusionsConclusions3CAP6938 CAP6938 ––3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 2008Historical Notes on Historical Notes on Game UIsGame UIsCAP6938 CAP6938 ––3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 2008Early VideoEarly VideoGamesGames1947: Cathode1947: Cathode--ray ray tube amusement devicetube amusement deviceprobably the earliest probably the earliest proposal for electronic proposal for electronic gaming devicegaming devicenot known if it was not known if it was implementedimplementedProposed interfaceProposed interfaceknobs and buttonsknobs and buttons4CAP6938 CAP6938 ––3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 2008Early Video Games Early Video Games Tennis for two:Tennis for two:Second ever video game:Second ever video game:19581958by by William William HiginbothamHiginbotham@ @ Brookhaven National Brookhaven National LaboratoryLaboratorydisplay: oscilloscope, Input: dial and a buttondisplay: oscilloscope, Input: dial and a buttonfirst ever computer game was invented by Douglas, A. first ever computer game was invented by Douglas, A. at Cambridge in 1952at Cambridge in 1952CAP6938 CAP6938 ––3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola