The H.264/AVCThe H.264/AVCVideo Coding StandardVideo Coding Standard(ITU(ITU--T Rec. H.264 | ISO/IEC 14496T Rec. H.264 | ISO/IEC 14496--10)10)Gary J. Sullivan, Ph.D.Gary J. Sullivan, Ph.D.ITUITU--T VCEG Rapporteur / ChairT VCEG Rapporteur / ChairISO/IEC MPEG Video Rapporteur / CoISO/IEC MPEG Video Rapporteur / Co--ChairChairITU/ISO/IEC JVT Rapporteur / CoITU/ISO/IEC JVT Rapporteur / Co--Chair Chair Microsoft Corporation Video ArchitectMicrosoft Corporation Video ArchitectNovember 2007November 2007Univ. Wash. Data Compression Class Guest Lecture, Nov 2007 Gary J. Sullivan 1Video CodingVideo CodingStandardization OrganizationsStandardization Organizations§ Two organizations have historically dominated general-purpose video compression standardization:• ITU-T Video Coding Experts Group (VCEG)International Telecommunications Union –Telecommunications Standardization Sector (ITU-T,a United Nations Organization, formerly CCITT),Study Group 16, Question 6• ISO/IEC Moving Picture Experts Group (MPEG)International Standardization Organization and International Electrotechnical Commission, Joint Technical Committee Number 1, Subcommittee 29, Working Group 11§ Recently, the Society for Motion Picture and Television Engineers (SMPTE) has also entered with “VC-1”, based on Microsoft’s WMV 9 but this talk covers only the ITU and ISO/IEC work.Univ. Wash. Data Compression Class Guest Lecture, Nov 2007 Gary J. Sullivan 21990 1996 20021992 1994 1998 2000H.263(1995-2000+)H.263(1995-2000+)MPEG-4 Visual(1998-2001+)MPEG-4 Visual(1998-2001+)MPEG-1 (1993)MPEG-1 (1993)ISO/IECITU-TH.120(1984-1988)H.120(1984-1988)H.261(1990+)H.261(1990+)H.262 / MPEG-2 (1994/95-1998+)H.262 / MPEG-2 (1994/95-1998+)H.264 / MPEG-4 AVC(2003-2007+)H.264 / MPEG-4 AVC(2003-2007+)Chronology of InternationalChronology of InternationalVideo Coding StandardsVideo Coding Standards2004Univ. Wash. Data Compression Class Guest Lecture, Nov 2007 Gary J. Sullivan 3The The ScopeScopeof Picture and Video of Picture and Video Coding StandardizationCoding Standardization§ Only the Syntax and Decoder are standardized:• Permits optimization beyond the obvious• Permits complexity reduction for implementability• Provides no guarantees of QualityPre-Processing EncodingSourceDestinationPost-Processing& Error RecoveryDecodingScope of StandardUniv. Wash. Data Compression Class Guest Lecture, Nov 2007 Gary J. Sullivan 4The Advanced Video CodingThe Advanced Video CodingProjectProjectAVC / ITUAVC / ITU--T H.264 / MPEGT H.264 / MPEG--4 part 104 part 10§ History: ITU-T Q.6/SG16 (VCEG - Video Coding Experts Group) “H.26L” standardization activity (where the “L” stood for “long-term”)§ Aug 1999:1sttest model (TML-1)§ July 2001: MPEG open call for technology: H.26L demo’ed§ Dec 2001: Formation of the Joint Video Team (JVT) between VCEG and MPEG to finalize H.26L as a new joint project (similar to MPEG-2/H.262)§ July 2002: Final Committee Draft status in MPEG§ Dec ‘02 Technical freeze, FCD ballot approved§ May ’03 Completed in both orgs§ July ’04 Fidelity Range Extensions (FRExt) completed§ Jan ’07 Professional Profiles completedUniv. Wash. Data Compression Class Guest Lecture, Nov 2007 Gary J. Sullivan 5§ Primary technical objectives:• Significant improvement in coding efficiency• High loss/error robustness• “Network Friendliness” (carry it well on MPEG-2 or RTP or H.32x or in MPEG-4 file format or MPEG-4 systems or …)• Low latency capability (better quality for higher latency)• Exact match decoding§ Initial extension objectives (in FRExt and Prof Profiles):• Professional applications (more than 8 bits per sample, 4:4:4 color sampling, etc.)• Higher-quality high-resolution video• Alpha plane support (a degree of “object” functionality)• Extended color gamut supportH.264/AVC ObjectivesH.264/AVC ObjectivesUniv. Wash. Data Compression Class Guest Lecture, Nov 2007 Gary J. Sullivan 6§ Test of different standards (ICIP 2002 study)§ Using same rate-distortion optimization techniques for all codecs§ Streaming test: High-latency (included B frames)• Four QCIF sequences coded at 10 Hz and 15 Hz (Foreman, Container, News, Tempete) and• Four CIF sequences coded at 15 Hz and 30 Hz (Bus, Flower Garden, Mobile and Calendar, and Tempete)§ Real-time conversation test: No B frames• Four QCIF sequences encoded at 10Hz and 15Hz (Akiyo, Foreman, Mother and Daughter, and Silent Voice)• Four CIF sequences encoded at 15Hz and 30Hz (Carphone, Foreman, Paris, and Sean)§ Compare four codecs using PSNR measure:• MPEG-2 (in high-latency/streaming test only)• H.263 (high-latency profile, conversational high-compression profile, baseline profile)• MPEG-4 Visual (simple and advanced simple profiles with & without B pictures)• H.264/AVC version 1 (with & without B pictures)§ Note: These test results are from a private study and are not an endorsed report of the JVT, VCEG or MPEG organizations.A ComparisonA Comparisonof of PerformancePerformanceUniv. Wash. Data Compression Class Guest Lecture, Nov 2007 Gary J. Sullivan 7ComparisonComparisonto MPEGto MPEG--2, H.263, 2, H.263, MPEGMPEG--4p24p2272829303132333435363738390 50 100 150 200 250Bit-rate [kbit/s]Foreman QCIF 10HzQualityY-PSNR [dB]MPEG-2 or MPEG-1H.263 (+)MPEG-4 Visual ASPMPEG-4 AVC/H.264Univ. Wash. Data Compression Class Guest Lecture, Nov 2007 Gary J. Sullivan 8MPEGMPEG--4 AVC/H.264 Structure4 AVC/H.264 StructureEntropyCodingScaling & Inv. TransformMotion-CompensationControlDataQuant.Transf. coeffsMotionDataIntra/InterCoderControlDecoderMotionEstimationTransform/Scal./Quant.-InputVideoSignalSplit intoMacroblocks16x16 lumasamples+chromaIntra-picture PredictionDeblockingFilterOutputVideoSignalUniv. Wash. Data Compression Class Guest Lecture, Nov 2007 Gary J. Sullivan 9EntropyCodingScaling & Inv. TransformMotion-CompensationControlDataQuant.Transf. coeffsMotionDataIntra/InterCoderControlDecoderMotionEstimationTransform/Scal./Quant.-InputVideoSignalSplit intoMacroblocks16x16 lumasamples+chromaIntra-picture PredictionDe-blockingFilterOutputVideoSignalMotion Compensation AccuracyMotion Compensation AccuracyMotion vector accuracy 1/4 sample for luma(6-tap filter) 8x804x80 10 12 34x48x4108x8Types016x160 18x16MBTypes8x80 12 316x810Univ. Wash. Data Compression Class Guest Lecture, Nov 2007 Gary J. Sullivan 10EntropyCodingScaling & Inv.
View Full Document
Unlocking...