ECE160 Lecture1 Spring 2011 Multimedia Introduction 1 ECE160 Multimedia Spring 2011ECE160 Lecture1 Spring 2011 Multimedia Introduction 2 Structure • Lectures: Tuesday and Thursday 3:30pm-4:45pm • Discussion/Lab: Tuesday, 5pm – 5:50pm Thursday, 9am – 9:50pm • Teaching assistants: Abhinav Anand ([email protected]), Nitin Chhabra ([email protected]) • Web site for ECE160, with powerpoint and assignments • Assignments: – One per week, not first or last week • Four Projects: – Video Editing – Audio Synthesis – Rendering – Animation • Grading: Assignments 20%, Projects 50%, Midterm 10%, Final 20%ECE160 Lecture1 Spring 2011 Multimedia Introduction 3 Introduction • What is Multimedia • Presentation – Hypermedia • Internet and Web • Multimedia Tools – Editing – SynthesisECE160 Lecture1 Spring 2011 Multimedia Introduction 4 What is Multimedia? • When different people mention the term multimedia, they have quite different, or even opposing, viewpoints. – A PC vendor: a PC that has sound capability, a DVD-ROM drive, and perhaps the superiority of multimedia-enabled microprocessors that understand additional multimedia instructions. – A consumer entertainment vendor: interactive cable TV with hundreds of digital channels available, or a cable TV-like service delivered over a high-speed Internet connection. – A student: applications that use multiple modalities, including text, images, drawings (graphics), animation, video, sound including speech, and interactivity.ECE160 Lecture1 Spring 2011 Multimedia Introduction 5 What is Multimedia? • One or more of – Video • Images • Text – Audio • Music • Speech – Touch – Taste (unlikely) – Smell (I hope not)ECE160 Lecture1 Spring 2011 Multimedia Introduction 6 What is Multimedia? • Digitization, encoding, compression, transmission, presentation of multimedia • Synthesis of multimedia • Recognition, indexing and retrieval of multimediaECE160 Lecture1 Spring 2011 Multimedia Introduction 7 Applications of Multimedia • Interactive Entertainment • Video teleconferencing. • Education and Training • Tele-medicine. • Co-operative work environments. • Searching in very large video and image databases for visual objects. • Augmented reality: placing real-appearing computer graphics and video objects into scenes. • Including audio cues for where video-conference participants are located. • Building searchable features into new video • Enabling very high- to very low- bit-rate use of scalable multimedia. • Making multimedia components editable. • Building inverse-Hollywood applications that can recreate the process by which a photograph, video or audio was made. • Using voice-recognition to build an interactive environment.ECE160 Lecture1 Spring 2011 Multimedia Introduction 8 Multimedia Topics • Multimedia processing and coding: multimedia content analysis, multimedia security, content-based multimedia retrieval, audio/image/video processing, compression, etc. • Multimedia system support and networking: network protocols, Internet, operating systems, servers and clients, quality of service (QoS), and databases. • Multimedia tools, end-systems and applications: hypermedia systems, user interfaces, authoring systems. • Multi-modal interaction and integration: ubiquity web-everywhere devices.ECE160 Lecture1 Spring 2011 Multimedia Introduction 9 Multimedia Research • Camera-based object tracking technology: tracking of the control objects provides user control of the process. • 3D motion capture: used for multiple actor capture so that multiple real actors in a virtual studio can be used to automatically produce realistic animated models with natural movement. • Multiple views: allowing photo-realistic (video-quality) synthesis of virtual actors from several cameras or from a single camera under differing lighting. • 3D capture technology: allow synthesis of highly realistic facial animation from speech.ECE160 Lecture1 Spring 2011 Multimedia Introduction 10 Multimedia Research • Specific multimedia applications: aimed at handicapped persons with low vision capability and the elderly, a rich field of endeavor. • Digital fashion: aims to develop smart clothing that can communicate with other such enhanced clothing using wireless communication, so as to artificially enhance human interaction in a social setting. • Electronic Housecall system: an initiative for providing interactive health monitoring services to patients in their homes • Augmented Interaction applications: used to develop interfaces between real and virtual humans for tasks such as augmented storytelling.ECE160 Lecture1 Spring 2011 Multimedia Introduction 11 History of Multimedia Technology • Musical instruments • Printing • Newspaper: perhaps the first mass communication medium, uses text, graphics, and images. • Motion pictures: conceived of in 1830's in order to observe motion too rapid for perception by the human eye. • Wireless radio transmission: Guglielmo Marconi, at Pontecchio, Italy, in 1895. • Television: the new medium for the 20th century, established video as a commonly available medium and has since changed the world of mass communications. • The connection between computers and ideas about multimedia covers what is actually only a short periodECE160 Lecture1 Spring 2011 Multimedia Introduction 12 History of Computers and Multimedia 1945 - Vannevar Bush wrote a landmark article describing what amounts to a hypermedia system called Memex. 1960: Ted Nelson coined the term hypertext. 1967: Nicholas Negroponte formed the Architecture Machine Group. 1968: Douglas Engelbart demonstrated the On-Line System (NLS), another very early hypertext program (and also bit mapped display and mouse). 1969: Nelson and van Dam at Brown University created an early hypertext editor called FRESS. 1976: The MIT Architecture Machine Group proposed a project entitled Multiple Media - resulted in the Aspen Movie Map, the first hypermedia videodisk, in 1978.ECE160 Lecture1 Spring 2011 Multimedia Introduction 13 1985: Negroponte and Wiesner founded the MIT Media Lab. 1989: Tim Berners-Lee proposed the World Wide Web 1990: Kristina Hooper Woolsey headed the Apple Multimedia Lab. 1991: MPEG-1 approved as an international standard for digital video - led to the newer standards, MPEG-2, MPEG-4