2009 Fall Interim report for EE 5359 Multimedia Processing Project Submitted by Swaminathan Sridhar MS EE UTA Multiplexing of AVS Part 2 video with AAC MPEG 2 Advanced Audio Coding Low Complexity Profile EE 5359 MULTIMEDIA PROCESSING PROJECT ACKNOWLEDGEMENT I would sincerely like to thank Dr Rao for his constant support and guidance throughout the duration of my project I would also like to thank Cui Bin for assisting me in my project Contents List of acronyms 4 1 AVS 1 a An overview on AVS codec 5 1 b Different profile levels in AVS 6 2 Picture formats of AVS part 2 6 3 AVS part2 video encoder 7 4 AVS part1 systems 8 5 Introduction to AAC bit stream 9 6 AVS H 264 bit stream syntax 11 7 AAC bit stream format for multiplexing 14 8 Conclusion 17 9 Simulation results 17 10 Matlab source code a For multiplexing 24 b For De multiplexing 25 11 References 27 List of Acronyms AAC Advanced audio coding AVS Audio Video Standard B Frame Interpolated frame CIF Common Intermediate format HD High Definition ICT Integer Cosine Transform I Frame Intra frame MB Macro Block ME Motion Estimation MP3 MPEG layer III MPEG Moving Pictures Expert Group MV Motion Vector P Frame Predicted Frame PS Program stream QCIF Quarter Common Intermediate Format SD Standard Definition TS Transport stream Proposal The objective of this project is to multiplex AVS Part 2 Jizhun Profile a k a Base Profile video with AAC audio bit stream and de multiplex the same while achieving lip sync 1 a An overview on AVS video codec 1 AVS Audio video coding standard is the digital video codec standard developed by China on a need to reduce the royalty fees paid by the Chinese people for using other international video coding standards like MPEG 2 MPEG 4 and MPEG 4 part 10 H 264 2 The three main characteristics of AVS China are that it is technically an advanced second generation source coding standard and is totally controlled and formulated by China At present AVS China is being used in IP television wherein TV programs are transmitted over the IP protocols and is also being tested for Chinese mobile multimedia broadcasting 1 AVS China primarily aims at providing high definition and high quality video services Since the basic syntax structure of AVS China is very similar to that of MPEG 2 standard it can be easily used in the present widely used MPEG 2 systems except for the fact that it has a higher coding efficiency 2 This refers that AVS China is compatible with the existing MPEG 2 systems and has an architecture model very similar to that of H 264 codec 2 AVS China has a coding efficiency similar to that of H 264 except that it has lower computational complexity AVS China has been divided into various parts and thus dividing the AVS China architecture into various sub fields The different parts of AVS China are as shown in Table 1 a AVS parts Contents Part 1 System for broadcasting Part 2 SD HD video Part 3 Audio Part 4 Conformance test Part 5 Reference software Part 6 Digital rights management Part 7 Mobility video Part 8 System over IP Part 9 File format Table 1 a Different parts of AVS China 2 1 b Different Profile levels on AVS codec 3 Table 1 b Different Profile levels on AVS codec 3 As seen from the above table Table 1 b Jizhun profile is considered to be the base profile with moderate computational complexity which is defined in AVS part2 i e video and is targeted mainly at digital video applications like commercial broadcasting and storage media and hence this profile is chosen in my project as an input video stream to the packetizer Jiben profile is also a basic profile which is defined in AVS part 7 i e Mobile and is targeted mainly at Mobile video applications Shenzan and Jiaqiang profiles are defined in AVS part video and are targeted at video surveillance and high density storage for multimedia entertainment respectively 2 a Picture formats of AVS part 2 video 2 Figure 1 a Picture formats of AVS part 2 video 2 Three types of pictures are defined by AVS namely Intra pictures I Predicted pictures P At most two reference frames P or I Interpolated pictures B two reference frames I or P or both 3 a AVS part 2 video encoder 2 Raw video Encoded video bit stream Figure 2 a AVS video encoder 2 3 b AVS part 2 video decoder 1 Figure 2 b AVS part 2 video decoder 1 4 a AVS part1 Systems 5 AVS part 1 a k a Systems comprises a set of standards that converts single multi channel audio and video bit stream into a single multiplexed stream for transmission and storage and also defines a encoding syntax which is necessary for synchronous de multiplexing of audio and video bit streams AVS System basically comprises of two data streams namely the program stream and transport stream where each one has its own applications AVS part1 complies with AVS part 2 or AVS part 7 video ASV part 3 audio AAC audio as its elementary bit stream 2 4 a i Program stream 5 Program stream is a single stream that consists of one or more packetized elementary stream audio video with a common time stamp which is necessary for synchronous decoding and is mainly designed for an error free environment which includes applications like interactive multimedia applications The input to the program stream decoder consists of two layers namely the systems and compression layer while the input to the audio and video decoder consists of only one layer namely the compression layer The rate of the program stream is defined by the synchronous clock reference rate SCR field in the PES 4 a ii Transport stream 5 Transport stream is a single stream that consists of one or more programs unlike the program stream that contains only one program per stream which can contain one or more different clock reference while the PES packets consisting of different elementary streams share a same clock reference Similar to the program stream transport stream also consists of two layers namely the systems and compression layers The process involved in multiplexing audio and video streams is shown in the figure 3 a Video Data Audio Data Video PES Video Encoder Packetizer PS MUX Program Stream TS MUX Transport Stream Audio PES Audio Encoder Packetizer Extent of Systems Specification Figure 3 a Basic process of multiplexing in AVS systems 5 Channel Channel decoder Program Stream decoder Program Stream Video decoder Decoded video Audio decoder Decoded audio Clock control Figure 3 b Decoder of a program stream 5 5 a Introduction to AAC audio bit stream 12 AAC audio technology is a wide
View Full Document
Unlocking...