2009 Fall Interim report for EE 5359 Multimedia Processing Project Submitted by, Swaminathan Sridhar, MS EE, UTA [ Multiplexing of AVS (Part 2) video with AAC (MPEG-2 Advanced Audio Coding Low Complexity Profile) EE 5359 MULTIMEDIA PROCESSING PROJECT]ACKNOWLEDGEMENT I would sincerely like to thank Dr. Rao for his constant support and guidance throughout the duration of my project. I would also like to thank Cui Bin for assisting me in my project.Contents List of acronyms --------------------------------------------------------- 4 1. AVS 1.a An overview on AVS codec --------------------------------- 5 1.b Different profile levels in AVS ----------------------------- 6 2. Picture formats of AVS part 2 -------------------------------------- 6 3. AVS part2 video encoder --------------------------------------------- 7 4. AVS part1 systems ----------------------------------------------------- 8 5. Introduction to AAC bit stream ------------------------------------- 9 6. AVS/H.264 bit stream syntax ------------------------------------------ 11 7. AAC bit stream format for multiplexing ---------------------------- 14 8. Conclusion ----------------------------------------------------------------- 17 9. Simulation results -------------------------------------------------------- 17 10. Matlab source code a. For multiplexing ------------------------------------------------------- 24 b. For De-multiplexing -------------------------------------------------- 25 11. References ---------------------------------------------------------------- 27List of Acronyms AAC Advanced audio coding AVS Audio Video Standard B-Frame Interpolated frame CIF Common Intermediate format HD High Definition ICT Integer Cosine Transform I-Frame Intra frame MB Macro Block ME Motion Estimation MP3 MPEG layer III MPEG Moving Pictures Expert Group MV Motion Vector P-Frame Predicted Frame PS Program stream QCIF Quarter Common Intermediate Format SD Standard Definition TS Transport streamProposal The objective of this project is to multiplex AVS (Part 2- Jizhun Profile a.k.a Base Profile) video with AAC audio bit stream and de-multiplex the same while achieving lip-sync. 1.a An overview on AVS video codec [1] AVS (Audio-video coding standard) is the digital video codec standard developed by China on a need to reduce the royalty fees paid by the Chinese people for using other international video coding standards like MPEG-2, MPEG-4 and MPEG-4 part 10 (H.264) [2]. The three main characteristics of AVS China are that, it is technically an advanced second generation source coding standard and is totally controlled and formulated by China. At present AVS China is being used in IP television wherein TV programs are transmitted over the IP protocols and is also being tested for Chinese mobile multimedia broadcasting [1]. AVS China primarily aims at providing high definition and high quality video services. Since the basic syntax structure of AVS China is very similar to that of MPEG-2 standard it can be easily used in the present widely used MPEG-2 systems except for the fact that it has a higher coding efficiency [2]. This refers that AVS China is compatible with the existing MPEG-2 systems and has an architecture model very similar to that of H.264 codec [2]. AVS China has a coding efficiency similar to that of H.264 except that it has lower computational complexity. AVS China has been divided into various parts and thus dividing the AVS China architecture into various sub fields. The different parts of AVS China are as shown in Table 1.a. AVS parts Contents Part 1 System for broadcasting Part 2 SD/HD video Part 3 Audio Part 4 Conformance test Part 5 Reference software Part 6 Digital rights management Part 7 Mobility video Part 8 System over IP Part 9 File format Table 1.a Different parts of AVS China [2]1.b Different Profile levels on AVS codec [3] Table 1.b Different Profile levels on AVS codec [3] As seen from the above table Table 1.b, Jizhun profile is considered to be the base profile with moderate computational complexity which is defined in AVS-part2 i.e. video and is targeted mainly at digital video applications like commercial broadcasting and storage media and hence this profile is chosen in my project as an input video stream to the packetizer. Jiben profile is also a basic profile which is defined in AVS- part 7 i.e. Mobile and is targeted mainly at Mobile video applications. Shenzan and Jiaqiang profiles are defined in AVS – part video and are targeted at video surveillance and high-density storage for multimedia entertainment respectively. 2.a Picture formats of AVS part 2 video [2]Figure 1.a Picture formats of AVS part 2 video [2] Three types of pictures are defined by AVS namely - Intra pictures (I) - Predicted pictures (P)- At most two reference frames (P or I) - Interpolated pictures (B)- two reference frames (I or P or both) 3.a AVS part 2 video encoder [2] Figure 2.a AVS video encoder [2] Raw video Encoded video bit stream3.b AVS part 2 video decoder [1] Figure 2.b AVS part 2 video decoder [1] 4.a AVS part1- Systems [5] AVS part 1 a.k.a Systems comprises a set of standards that converts single/multi channel audio and video bit stream into a single multiplexed stream for transmission and storage and also defines a encoding syntax which is necessary for synchronous de-multiplexing of audio and video bit streams. AVS System basically comprises of two data streams namely the program stream and transport stream where each one has its own applications. AVS part1 complies with AVS part 2 or AVS part 7 video, ASV part 3 audio, AAC audio as its elementary bit stream [2]. 4.a.i Program stream [5] Program stream is a single stream that consists of one or more packetized elementary stream (audio/video) with a common time stamp which is necessary for synchronous decoding and is mainly designed for an error free environment which includes applications like interactive multimedia applications. The input to the program stream decoder consists of two layers namely the systems and compression layer while the input to the audio and video decoder consists of only one layer namely the compression layer. The rate of the program
View Full Document
Unlocking...