Wearable Computer & E-TextilesOutlineDefinition: Steve MannAugmented Reality (AR)Mediated RealityAttributesSlide 7Slide 8Slide 9Existing SystemsMIT Media Lab: MIThrilSystem SpecsMore SpecsPeripherals connected to CoreSoftwareMemory GlassMore on Memory GlassThe Georgia Tech Wearable Motherboard™Topics of DiscussionMotivationsHighlighted TechnologiesHighlighted Technologies (cont’d)Slide 23Slide 24Slide 26Slide 27ApplicationsApplications (cont’d)Application (cont’d)Slide 31CMU: Wearable Computer ProjectSeveral Projects UnderwayVuManNavigator 2TIA-PTIA-OMetronautISAACDaimler-Benz/AdtranzMoCCAMoCCADigital InkSpeech Translator/ Smart ModuleSpeech Translator/Smart ModuleWRL ItsyGovernment ProgramsReferencesSlide 49Wearable Computer & E-TextilesByGee Hang LuiSandeep VardhanChih-Chieh HanOutlineDefinitionsBackgroundExisting SystemsMIThrilGeorgia Tech Wearable MotherboardCMUDefinition: Steve Mann3 operational modesConstancySystem may sleep, but never deadNo need to boot the system in order to use it.AugmentationMediationAugmented Reality (AR)Combination the real and the virtual to assist the user in his environmentExamples:1. Finger Tracking2. Face Recognition3. Visual Filter4. Navigation5. Repair instruction(http://lcs.www.media.mit.edu/projects/wearables/lizzy/augmented-reality.html)Mediated RealityPersonal Visual AssistantEmbodies a spatial visual filterReconfigures the human visual systemProviding a coordinate transformationVisual Memory ProstheticEmbodies a temporal visual filterProvides computer-induced flashbacks(http://n1nlf-1.eecg.toronto.edu/tetherless/tetherless.html)AttributesUnmonopolizingAttend to other matter while using itEnhancement of sensory capabilitiesMay mediate the sensory capabilitiesUnrestrictiveYou can do other things while using itExample:You can type while runningAttributesObservableCan get your attention continuously if you want it toThe output medium is constantly perceptible by the wearerControllableResponsiveCan grab control of it at any timeCan manually override to break the control loopAttributesAttentiveEnvironmentally awareContext sensitiveCommunicativeCan be used as a communications mediumAllow the wearer to be expressive through the mediumExisting SystemsSystem that composed of gadgets1. MIThril2. CMU VuMan3. Others http://www.praecogito.com/~brudy/wearable.html)System woven into shirt fabric1. GTWM/SensatexMIT Media Lab: MIThrilSystem Specs1. 3 cores2. MPC823 + Altera FPGA single-board computer from Brightstar Engineering3. Intel SA 1110 Strong-Arm based Intrinsyc CerfBoard 4. 802.11More Specs1. 2 Interfaces (USB and I2C) for connecting peripherals including2. I2C tag-reader 3. I2C 2G 1% accuracy three-axis accelerometer4. USB microphones 5. camerasPeripherals connected to CoreKopin CyberDisplay 320 Color 320 to BrightstarTwiddler One chording keyboard to BrightstarDebugging console serial ports to Brightstar and CerfBoardSoftwareModified 2.4 PPC linux kernelDebian Arm linux on the CerfBoard“Memory Glasses” (explain next)Memory GlassWearable, proactive, and context-aware memory aidA reminder systemdelivery of information is situation conditioned; reminders are associated with context and are delivered when and where appropriateMore on Memory GlassProactive: Deliver information when necessaryContext aware: Deliver information according to user’s contextThe Georgia Tech Wearable Motherboard™What is a Wearable Motherboard™?An infrastructure integrated with sensors that you can wear.Why needed?A systematic way of monitoring the vital signs of humans in an unobtrusive manner.Topics of DiscussionMotivationsHighlighted technologiesApplicationsMotivationsMonitoring humans’ vital signsHeart rateEKG (electrocardiograph)Body temperatureRespiration rate, etc.Know more about the status of a human body by integrating the above biological phenomenon. Apply to……Combat fieldMedical applicationsMore applications later……Highlighted TechnologiesPlastic Optical Fiber (POF)spirally integrated into the structure during the fabric production process. is woven with other specialty fibers throughout the actual fabric of the shirt To pinpoint the exact location of a bullet penetration.Highlighted Technologies (cont’d)Interconnection TechnologyData bus structureTransmit information from and to the sensors mounted at any location on the body. T-connectorssensors are plugged into T-connectorsAllowing sensors to transmit information to multi-function processor (pager-size)Highlighted Technologies (cont’d)Fully customizable (various sensors)Respitrace™ sensorEKG sensorThermistor-type sensorOxygen level sensor (fire fighters)Can be launderedHighlighted Technologies (cont’d)Distribution of collected data from sensorsTransceiver sends data to a wireless gateway. Data are then sent via internetThen various type of client can access the data, e.g. medical doctor, medical data server, etc.ApplicationsConsumer productsMedical productsMilitary and occupational productsApplications (cont’d)Consumer productsAmateur / Individual SportsMonitor heart rate, respiration rate, body temperature, altitude, location, orientation, etc.Team Athletic trainingBy analyzing athlete’s vital signs, coaches and trainers can manage the training more efficiently.Application (cont’d)Medical ProductsMonitoring of patients in post-operative recoveryPatients can go back home. Information of the patients can be transmitted to the data server of the hospital via internet. Infant vital signs monitoringContinuously monitoring the vital signs of a newborn bady. Avoid the infection of diseases and virus more efficiently.Application (cont’d)Military and occupational productsBattle combat careCMU: Wearable Computer ProjectDeveloping a new class of computing systems with a small footprintShould be carried or worn by a human and be able to interact with computer-augmented environmentsRelate to access to information18 generations have been designed and built over the last seven and a half years. Most have been field-testedSeveral Projects UnderwayVuManUser can maneuver and interact with “Private Eye” Gives the illusion of