1Bernd Girod: EE368 Digital Image Processing Introduction no. 1Image and Video CompressionEE368bBernd GirodInformation Systems LaboratoryDepartment of Electrical EngineeringStanford UniversityFall 2000/01Bernd Girod: EE368b Image and Video Compression Introduction no. 2Introductionn A brief history of (electronic) image communicationl Invention of photography and cinemal Invention of televisionl Introduction of television broadcastingn Current technological challengesn Technological key problemsn What will be covered in this course?n Organisation2Bernd Girod: EE368b Image and Video Compression Introduction no. 3Perspective ProjectionBernd Girod: EE368b Image and Video Compression Introduction no. 4Perspective Projection II3Bernd Girod: EE368b Image and Video Compression Introduction no. 5Photography and Cinema18401895End 1920s1930sLouis J. M. Daguerre, FranceWilliam Henry Fox Talbot, USAphotographic filmFirst public motion picture presentationLumière brothers, France)Sound motion pictures: „talkies“Color moviesBernd Girod: EE368b Image and Video Compression Introduction no. 6Nipkow Disk Iphotodetectorarea light sourceReceiverTransmitterNipkow diskviewing window transmission line amplifier amplifier motor motorobserverlens4Bernd Girod: EE368b Image and Video Compression Introduction no. 7Nipkow Disk IIBritish TV pioneer J.L. Baird with Nipkow disk (around 1926) Bernd Girod: EE368b Image and Video Compression Introduction no. 8Image Transmission by Line Scanningtime t5Bernd Girod: EE368b Image and Video Compression Introduction no. 9Cathode Ray Tube (Braun)Bernd Girod: EE368b Image and Video Compression Introduction no. 10History of Electronic Image Communication I1920s1930-321935First television experimentsFirst experimental television broadcasting (New York City)First German television broadcasting in BerlinTV transmission during the Berlin summer olympics 1936 using an iconoscope camera6Bernd Girod: EE368b Image and Video Compression Introduction no. 11History of Electronic Image Communication II193919__1952195419__19671970slate 70s1980sRegular monochrome TV service in the USFirst regular TV service in ________First regular TV service in GermanyIntroduction of NTSC color television in USIntroduction of _____ color television in ___PAL color television in GermanyConsumer video cassette recorder (VCR)Fax machines Digital TV studios (ITU-R Rec. 601)Dr.-Ing. h.c. Walter Bruch, inventor of the PAL systemBernd Girod: EE368b Image and Video Compression Introduction no. 12Recent Developments: 1990sn JPEG and MPEG standardsn Digital still camerasn Digital TV broadcastingn Digital video/versatile disk (DVD)n Integration of computers and video n World Wide Webn Internet video streamingEach “recent development” depends on efficient compression of images or video!Each “recent development” depends on efficient compression of images or video!7Bernd Girod: EE368b Image and Video Compression Introduction no. 13Motivating Image Compressionn Binary image (fax)l 8.5 x 11 in document scanned at 7.7 lines/mm with 1 bit/pixell 4.1 Mbits for 1 page = 7 minutes over 9600 baud connectionn Photos on 35 mm filml Scanned at 12µ resolution (3656x2664 pixels) with 8 bits per color and 3 colorsl 233 Mbits for 1 photo, 2/3 of 48 Mbyte compact flash cardBernd Girod: EE368b Image and Video Compression Introduction no. 14Motivating Video CompressionY Cr CbSampling rate 13.5 MHz 6.75 MHz 6.75 MHzQuantization 8 bit 8 bit 8 bitRaw bit rate 216 MbpsW/o blanking intervals 166 Mbpsn Digital video studio standard ITU-R Rec. 601n Some interesting bit-ratesl Terrestial TV broadcasting channel ~20 Mbpsl Computer hard disk 20...40 Mbpsl DVD (max. 17 GB/length of movie) 10...20 Mbpsl Ethernet/Fast Ethernet <10/100 Mbpsl DSL downlink 384...2048 kbpsl V.34 modem 28.8 kbpsl Wireless cellular data 9.6...112 kbps8Bernd Girod: EE368b Image and Video Compression Introduction no. 15Outline EE368bn Some fundamental results of information theoryn Scalar quantization and vector quantizationn Human visual perceptionn Predictive codingn Transform codingn Resolution pyramids and subband codingn Interframe codingn Motion estimationn Motion compensated codingn Coding standards JPEG, H.261, H.263 and MPEGBernd Girod: EE368b Image and Video Compression Introduction no. 16Prerequisites EE368bn Requiredl Signals and systems, e.g., EE261l Statistical signal processing, e.g., EE278n NOT requiredl Information theory, will be reviewed in classl EE368a (Digital Image Processing)9Bernd Girod: EE368b Image and Video Compression Introduction no. 17EE368b Organisationn Regularly check class home page: http://www.stanford.edu/class/ee368bn Mailing list: Send mail to [email protected] ee368bn Assistantsl General TA: Markus Flierll ISE lab TA: Sung-Won Yoonl Course assistant: Kelly YilmazBernd Girod: EE368b Image and Video Compression Introduction no. 18EE368b Organisation (cont.)n Homeworksl 3-4 problem sets, require computer + Matlabl Term projectl Individually or in groups, 40-50 hours per personl Project approval required, deadline: October 31l Class-room presentations of projects: Dec. 1-8l Web submission of project report: deadline Dec. 1, no extensions!n Gradingl Homeworks: 25%l Mid-term: 25%l Term project: 50%l No final.10Bernd Girod: EE368b Image and Video Compression Introduction no. 19ISEP laboratoryn Created by an equipment grant from Hewlett-Packard Corporation and Xerox Corporation.n Exclusively a teaching laboratoryn Location: Packard room 066n 11 HP Workstations, 2 PCs, scanners, printers etc.n Access: l door combination for lab entry will be provided to subscribers to ee368b mailing listl Stanford ID chip card for after-hour entry of Packard buildingl Account on ise machine will be provided to subscribers to ee368 mailing list Bernd Girod: EE368b Image and Video Compression Introduction no. 20Further readingn Slides available as hand-outs and as pdf files on the webn Reference books on image and video compressionl A. N. Netravali, B.G. Haskell, "Digital Pictures - Representation and Compression", 2nd edit., New York, London: Plenum Press, 1995. Comprehensive standard book covering television standards and digital image compression. Has been augmented compared to the 1st edition from 1988, particularly to discuss the more recent standards, the greater part of the book, however, reflects the state-of-the-art of the mid-80s. Nevertheless, a must-have for image system engineers. l W. Pennebaker,