Human Interface where the bits meet the flesh bits meets eyes and earsResearch ThemeSlide 3Discrete EventsComparator- Ideal SignalComparator- Real World Signal Noise in input causes output jitterTriggering Discrete Events with HysteresisTV Synth InterfaceSlide 9Mouse SensorsWireless DoorbellWireless Motion DetectorSlide 13Working with Continuous OutputPowerGlove Protoype (VPL 1983)DataGlove (Fiber Optic)Head Mounted Display (NASA 1986)PowerGlove (Mattel 1987)The Spirit Chair (MIT 1994)Slide 20Contagious Information (MIT 1995)Car Seat Sensor (NEC 1998)Musical InstrumentsVocalizer (Breakaway 1981)Singing Coach (Exploratorium 1990)RePerformer (Zim/Wantman 1992)Pen InputPen That Remembers Everything You Write (IBM 2000-2002)Other Pen SystemsToy PensSlide 31Electric Field Pen (IBM 1997)Dynamic Signature Verification “Sign and Go” (2003)BiometricsClassification of BiometricsIdentification & VerificationPerformance MetricsBiometric ComparisonTangible ProgrammingLogo CardsSlide 41Slide 42Programming Robots with Playing CardsTelepresenceDummy Head Electronics (IBM 2003)Slide 46Techno HeadSlide 48Shopping BuddyMuseum InterfacesSizzling JelloSlide 52Bubble MachineSlide 54Bubble Strobe MachineQuestions???Badge Computer (IBM 1998)NZ Airport Travel Card (IBM 1998)Multi-Function PDA (IBM 2001)BioPDA Wireless Biometric TerminalUsing the Biometric Wireless TerminalHuman InterfaceHuman Interfacewhere the bits meet the fleshwhere the bits meet the fleshbits meets eyes and earsbits meets eyes and earsTom ZimmermanTom ZimmermanIBM Almaden Research CenterIBM Almaden Research CenterSan Jose, CaliforniaSan Jose, [email protected]@almaden.ibm.comOctober 2007October 2007Think beyond the boxResearch Theme Research Theme Transducers; Transducers; Converting one thing into anotherConverting one thing into another User Interface, User Experience, First PersonUser Interface, User Experience, First PersonHooking people to gadgetsHooking people to gadgets–Bits Meet the FleshBits Meet the Flesh–Bits Meet Eyes & EarsBits Meet Eyes & EarsTransducer ExamplesTransducer Examples–Dance into Music (dance synthesizer, suction cup)Dance into Music (dance synthesizer, suction cup)–Hand into Finger Spelling (DataGlove)Hand into Finger Spelling (DataGlove)–Sound into Light (Singing Coach)Sound into Light (Singing Coach)Violin Home Health Monitoring Contact MicroscopeVR Data Glove Personal Area Network Honda Smart SeatFantasy & Necessity Are the Mothers of InventionDiscrete EventsDiscrete EventsConverting continuous input into Converting continuous input into discrete events.discrete events.Continuous input examplesbrightness, sound level, pressureDiscrete output; 0/1, off/on, mouse clickComparator- Ideal SignalComparator- Ideal SignalSensorContinuous Input Quantized DigitizedOutputThresholdSensor+_ThresholdDigital OutputComparator- Real World SignalComparator- Real World SignalNoise in input causes output jitterNoise in input causes output jitterthresholdcross high for on cross low for offTriggering Discrete Events Triggering Discrete Events with Hysteresiswith HysteresisContinuous Input (e.g. brightness, sound level, pressure)Quantized/DigitizedOutputHigh thresholdLow thresholdHysteresis, “play”cross high for on cross low for offTV Synth InterfaceTV Synth InterfaceHacking Remotes, Mice, KbdCircuit Board4066Quad CMOS SwitchPhoto TransistorComparatorw/ hysteresis60 HzFilterMouseKeyboardIR RemoteSynthesizerTVSensor Signal Processing SwitchMouse SensorsMouse Sensors• Microphone; Speaker Radiation Pattern• Light; Water Ripple Tank• Ultrasonics; Wavelength, Horn Radiation Pattern• Temperature; Weather Station• Wind speed; See Jet Stream, Car Aerodynamics• Pressure• Tilt• Rpm• Vibration• Pendulum; Simple Harmonic Motion• Acceleration; Seismograph, Earthquakes, Cars/Trucks• Voltage• Current• Resistance• Capacitance• Magnetic field • Electric field• Left button • Right button• X direction• X increment• Y direction• Y increment1 to 100 HzWireless Doorbell Wireless DoorbellWireless Motion DetectorWireless Motion DetectorWorking with Continuous OutputWorking with Continuous OutputPowerGlove Protoype (VPL 1983)PowerGlove Protoype (VPL 1983)DataGlove DataGlove (Fiber Optic)(Fiber Optic) Fiber Optic Polhemus Magnetic Fiber Optic Polhemus Magnetic Flex SensorsFlex Sensors Position & OrientationPosition & OrientationsensorsourceYoung HarvillHead Mounted DisplayHead Mounted Display(NASA 1986)(NASA 1986)PowerGlove (Mattel 1987)PowerGlove (Mattel 1987) Computer Data Entry And 1.3 Million SoldManipulation Apparatus And Method $89 RetailThe Spirit Chair (MIT 1994)The Spirit Chair (MIT 1994)Mediums use spirit cabinets to guide fieldsto contact spirits who make sounds ...Data In Data OutNear-Field Communication (MIT/IBM 1995)Contagious Information Contagious Information (MIT 1995)(MIT 1995)7/11FredJanBillCar Seat Sensor (NEC 1998)Car Seat Sensor (NEC 1998)Musical InstrumentsMusical InstrumentsHuman ActionsMusicalInstrumentPitchAmplitudeTimbreDurationVocalizer (Breakaway 1981)Vocalizer (Breakaway 1981)Singing Coach (Exploratorium 1990)Singing Coach (Exploratorium 1990)RePerformer (Zim/Wantman 1992)RePerformer (Zim/Wantman 1992)Pen InputPen InputPen That Remembers Everything You Write Pen That Remembers Everything You Write (IBM 2000-2002)(IBM 2000-2002)Premiere UI unobtrusive, low cognitive load, small, portable, quick, cheapUniversal any languagepopular input methodclassic form factorModelesstext, graphics, doodle comment on documentdirect manipulationBUT hard to index, search, archive, distributeOther Pen SystemsOther Pen SystemsPDA; writing on plastic LCD; writing on glassTablet; invisible writing CrossPad; writing on 2 lbs.Toy PensToy PensBattery (AAA)InkCPU and Flash MemoryCMOS ImagerLensNormal or dot code paperPen Research (IBM 2002)Ultrasonic OpticalIRDAElectric Field Pen (IBM 1997)Electric Field Pen (IBM 1997)Dynamic Signature VerificationDynamic Signature Verification“Sign and Go” (2003)“Sign and Go” (2003)• Biometric verification using handwriting cadence (timing)• A means to electronically verify customer signatures • Customer signs on a digital signature capture station• Software checks signature against reference signatures and checks for major changes
View Full Document
Unlocking...