Implementation of H.264 using JM and Intel IPP Interim Report for EE 5359 - Multimedia Processing, Spring 2011. Instructor: Dr. K.R. Rao [email protected] Id:1000659642 Abstract: The main goal of this project is to implement the different profiles of H.264 [1] and [3] using JM and Intel softwares. The implementation would be on various test sequences in different formats like CIF (Common Intermediate Format), QCIF (Quarter Common Intermediate Format) and SD/HD. Comparison is done based on metrics like MSE (Mean Square Error), PSNR (Peak – to- Peak Signal to Noise Ratio), SSIM (Structural Similarity Index Metric), encoding time, decoding time and the compression ratio of the H.264 file size (encoded output). Overview of H.264: H.264/AVC is the newest international video coding standard. It is also known as MPEG-4 Part 10, or MPEG-4 AVC (advanced video coding) [10]. It is the latest block-oriented motion-compensation-based video standard developed by the ITU-T video coding experts group (VCEG) together with the ISO/IEC moving picture experts group (MPEG), and it was the product of a partnership effort known as the joint video team (JVT) [7]. Encoder and decoder block diagrams are shown in Figures 1 and 2 respectively [3]. H.264/AVC standard is developed to provide good video quality at substantially lower bit rates than previous standards like MPEG-2, H.263 or MPEG-4 Part 2 without affecting the design complexity [8] and [11]. The standard provides integrated support for transmission or storage, including a packetized compressed format and features that help to minimize the effect of transmission errors. Different Profiles in H.264: H.264 standard defines numerous profiles, as listed below. Constrained Baseline Profile (CBP): Primarily for low-cost applications this profile is used widely in videoconferencing and mobile applications. It corresponds to the subset of features that are common between the Baseline, Main, and High Profiles. Baseline Profile (BP): Primarily for low-cost applications that require additional error robustness, this profile is used rarely in videoconferencing and mobile applications, and it addsadditional error resilience tools to the Constrained Baseline Profile. The importance of the baseline profile is fading after the Constrained Baseline Profile has been defined. Figure 1. H.264/AVC encoder block diagram for a macroblock [3]. Figure 2. H.264/MPEG-4 AVC decoder block diagram [3].Main Profile (MP): This was originally intended as the mainstream consumer profile for broadcast and storage applications. The importance of this profile faded when the High profile was developed for these applications. Extended Profile (XP): This was intended as the streaming video profile. This profile has relatively high compression capability. It has some extra tricks for robustness to data losses and server stream switching. High Profile (HiP): This is the primary profile for broadcast and disc storage applications, particularly for high-definition television applications. This is the profile adopted into HD DVD and Blu-ray Disc. There are four High Profiles (Fidelity range extensions). They are: High 10 Profile (Hi10P): Going beyond today's mainstream consumer product capabilities, this profile builds on top of the High Profile, adding support for up to 10 bits per sample of decoded picture precision. High 4:2:2 Profile (Hi422P): This profile primarily targets professional applications that use interlaced video. It builds on top of the High 10 Profile, adding support for the 4:2:2 chroma sub sampling format while using up to 10 bits per sample of decoded picture precision. High 4:4:4 Predictive Profile (Hi444PP): This profile builds on top of the High 4:2:2 Profile, supporting up to 4:4:4 chroma sampling, up to 14 bits per sample, and additionally supporting efficient lossless region coding and the coding of each picture as three separate color planes. CAVLC 4:4:4 intra profile: The High 4:4:4 Profile constrained to all-Intra use and to CAVLC entropy coding (i.e., not supporting CABAC). As a result of the Scalable Video Coding (SVC) extension, the standard contains three additional scalable profiles, which are defined as a combination of a H.264/AVC profile for the base layer and tools that achieve the scalable extension [15]: Scalable baseline profile: Primarily targeting video conferencing, mobile, and surveillance applications, this profile builds on top of a constrained version of the H.264/AVC Baseline profile to which the base layer (a subset of the bitstream) must conform. For the scalability tools, a subset of the available tools is enabled. Scalable high profile: Primarily targeting broadcast and streaming applications, this profile builds on top of the H.264/AVC High Profile to which the base layer must conform.Scalable high intra profile: Primarily targeting production applications, this profile is the Scalable High Profile constrained to all-Intra use. As a result of the Multi Video Coding (MVC) extension, the standard contains two multiview profiles: Stereo high profile: This profile targets two – view stereoscopic 3D video and combines the tools of the High profile with the inter – view prediction capabilities of the MVC extension. Multiview high profile: This profile supports two or more views using both inter–picture (temporal) and MVC inter-view prediction, but does not support field pictures and macroblock-adaptive frame-field coding. Feature CBP BP XP MP HiP Hi10P Hi422P Hi444PP B slices No No Yes Yes Yes Yes Yes Yes SI and SP slices No No Yes No No No No No Flexible macroblock ordering(FMO) No Yes Yes No No No No No Arbitrary slice ordering (ASO) No Yes Yes No No No No No Redundant slices (RS) No Yes Yes No No No No No Data partitioning No No Yes No No No No No Interlaced coding (PicAFF, MBAFF) No No Yes Yes Yes Yes Yes Yes CABAC entropy coding No No No Yes Yes Yes Yes Yes 8x8 vs. 4x4 transform adaptivity No No No No Yes Yes Yes Yes Quantization scaling matrices No No No No Yes Yes Yes Yes Separate Cb and Cr QP control No No No No Yes Yes Yes Yes Monochrome (4:0:0) No No No No Yes Yes Yes Yes Chroma formats 4:2:0 4:2:0 4:2:0 4:2:0 4:2:0 4:2:0 4:2:0/4:2:2 4:2:0/4:2:2/4:4:4 Sample depths (bits)
View Full Document
Unlocking...