ECE160 Lecture1Spring 2008MultimediaChapter 1 Introduction1ECE160 / CMPS182MultimediaSpring 2008Text: Fundamentals of MultimediaLi and Drew, Prentice HallECE160 Lecture1Spring 2008MultimediaChapter 1 Introduction2Structure• Lectures: Tuesday and Thursday 5pm-6:15pm• Discussion/Lab: Wednesday 1:15pm-4pm and 4pm-7pm– TA Office Hours: Nathan : Monday 1:30-2:30pm, Phelps 1435 Sandeep: Friday 1:30-2:30pm, Phelps 1435• Assignments:– One per week, not first or last week• Four Projects:– Video Editing– Audio Synthesis– Rendering– Animation• Grading: Assignments 20%, Projects 50%, Midterm 10%, Final 20%ECE160 Lecture1Spring 2008MultimediaChapter 1 Introduction3Introduction• What is Multimedia• Presentation– Hypermedia• Internet and Web• Multimedia Tools– Editing– SynthesisECE160 Lecture1Spring 2008MultimediaChapter 1 Introduction4What is Multimedia?• When different people mention the term multimedia,they have quite different, or even opposing, viewpoints.– A PC vendor: a PC that has sound capability, a DVD-ROM drive,and perhaps the superiority of multimedia-enabledmicroprocessors that understand additional multimediainstructions.– A consumer entertainment vendor: interactive cable TV withhundreds of digital channels available, or a cable TV-like servicedelivered over a high-speed Internet connection.– A student: applications that use multiple modalities, includingtext, images, drawings (graphics), animation, video, soundincluding speech, and interactivity.ECE160 Lecture1Spring 2008MultimediaChapter 1 Introduction5What is Multimedia?• One or more of– Video• Images• Text– Audio• Music• Speech– Touch– Taste (unlikely)– Smell (I hope not)ECE160 Lecture1Spring 2008MultimediaChapter 1 Introduction6What is Multimedia?• Digitization, encoding, compression,transmission, presentation of multimedia• Synthesis of multimedia• Recognition, indexing and retrieval ofmultimediaECE160 Lecture1Spring 2008MultimediaChapter 1 Introduction7Applications of Multimedia• Interactive Entertainment• Video teleconferencing.• Education and Training• Tele-medicine.• Co-operative work environments.• Searching in very large video and image databases for target visual objects.• Augmented reality: placing real-appearing computer graphics and videoobjects into scenes.• Including audio cues for where video-conference participants are located.• Building searchable features into new video• Enabling very high- to very low- bit-rate use of scalable multimedia.• Making multimedia components editable.• Building inverse-Hollywood applications that can recreate the process bywhich a photograph, video or audio was made.• Using voice-recognition to build an interactive environment.ECE160 Lecture1Spring 2008MultimediaChapter 1 Introduction8Multimedia Topics• Multimedia processing and coding:multimedia content analysis, multimedia security,content-based multimedia retrieval,audio/image/video processing, compression, etc.• Multimedia system support and networking:network protocols, Internet, operating systems, serversand clients, quality of service (QoS), and databases.• Multimedia tools, end-systems and applications:hypermedia systems, user interfaces, authoring systems.• Multi-modal interaction and integration:ubiquity web-everywhere devices.ECE160 Lecture1Spring 2008MultimediaChapter 1 Introduction9Multimedia Research• Camera-based object tracking technology: tracking ofthe control objects provides user control of the process.• 3D motion capture: used for multiple actor capture sothat multiple real actors in a virtual studio can be used toautomatically produce realistic animated models withnatural movement.• Multiple views: allowing photo-realistic (video-quality)synthesis of virtual actors from several cameras or froma single camera under differing lighting.• 3D capture technology: allow synthesis of highlyrealistic facial animation from speech.ECE160 Lecture1Spring 2008MultimediaChapter 1 Introduction10Multimedia Research• Specific multimedia applications: aimed athandicapped persons with low vision capability and theelderly, a rich field of endeavor.• Digital fashion: aims to develop smart clothing that cancommunicate with other such enhanced clothing usingwireless communication, so as to articially enhancehuman interaction in a social setting.• Electronic Housecall system: an initiative for providinginteractive health monitoring services to patients in theirhomes• Augmented Interaction applications: used to developinterfaces between real and virtual humans for taskssuch as augmented storytelling.ECE160 Lecture1Spring 2008MultimediaChapter 1 Introduction11History of Multimedia Technology• Musical instruments• Printing• Newspaper: perhaps the first mass communicationmedium, uses text, graphics, and images.• Motion pictures: conceived of in 1830's in order toobserve motion too rapid for perception by the human eye.• Wireless radio transmission: Guglielmo Marconi, atPontecchio, Italy, in 1895.• Television: the new medium for the 20th century,established video as a commonly available medium andhas since changed the world of mass communications.• The connection between computers and ideas aboutmultimedia covers what is actually only a short periodECE160 Lecture1Spring 2008MultimediaChapter 1 Introduction12History of Computers and Multimedia1945 - Vannevar Bush wrote a landmark article describingwhat amounts to a hypermedia system called Memex.1960: Ted Nelson coined the term hypertext.1967: Nicholas Negroponte formed the ArchitectureMachine Group.1968: Douglas Engelbart demonstrated the On-LineSystem (NLS), another very early hypertext program(and also bit mapped display and mouse).1969: Nelson and van Dam at Brown University created anearly hypertext editor called FRESS.1976: The MIT Architecture Machine Group proposed aproject entitled Multiple Media - resulted in the AspenMovie Map, the first hypermedia videodisk, in 1978.ECE160 Lecture1Spring 2008MultimediaChapter 1 Introduction131985: Negroponte and Wiesner founded the MIT Media Lab.1989: Tim Berners-Lee proposed the World Wide Web1990: Kristina Hooper Woolsey headed the AppleMultimedia Lab.1991: MPEG-1 approved as an international standard fordigital video - led to the newer standards, MPEG-2,MPEG-4 in the 1990s.1991: PDAs began a new period in the use of computers inmultimedia.1992: JPEG accepted as the international standard
View Full Document