Audio Video Coding Standard AVS Video Techniques Prof YU Lu Zhejiang University Institute of Information and Communication Engineering yul zju edu cn Oct 20 2004 1 Outline Standard structure of AVS video AVS video 1 0 AVS M Technical characteristics of AVS video 1 0 Outline of AVS M AVS Tutorial Oct 20 2004 2 Short History of AVS Mar18 21 2002 178th Xiangshan Science Conference Beijing Broad band Network and Security Stream Media Technology June 11 2002 Science and Technology Department of MII released a bulletin about setting up Audio Video Coding Standard Workgroup on China Electronics News June 21 2002 Audio Video Coding Standard Working Group was set up in Beijing Aug 23 24 2002 first meeting of AVS AVS united with MPEG China Website of AVS opened to the members formally Dec 9 2002 Department of Science and Technology of Ministry of Information Industry issued the notice of Setting up Audio Video Coding Standard Working Group and assigned the task of the group Dec 19 2003 On the 7th AVS meeting AVS video 1 0 and AVS system 1 0 was finalized AVS Tutorial Oct 20 2004 3 Short History of AVS Mar 29 2004 Industry forum of AVS video coding technology towards 3G ShenZhen sponsored together with universities and companies of Hong Kong Mar 30 31 2004 Start up the video coding standardization for new generation of mobile communication AVS Tutorial Oct 20 2004 4 Standard Structure of AVS Video 2002 Q1 Q2 High Definition Standard Definition Digital TV Broadcasting and Optical Storage Media Applications Mobile Multimedia Q3 2003 Q4 Q1 Q2 Q3 2004 Q4 Q1 Q2 2005 Q3 Q4 Q1 Q2 Q3 2006 Q4 Q1 Q2 Q3 AVS 1 0 Video Jizhun Profile AVS 1 0 System AVS 1 0 Audio AVS Advanced profile AVS M Video Stage 1 AVS M Video Stage 2 AVS Tutorial Oct 20 2004 5 Q4 AVS Video Working Style Requirement Call for proposal common test condition Technical proposal with technical explanation and experiment result under common test condition Review cross check core experiment Make decision Edit standard document and release reference software Corrigenda 430 technical proposals in all 10 AVS meetings up to Sep 2004 AVS Tutorial Oct 20 2004 6 Technical Framework of AVS video AVS Tutorial Oct 20 2004 7 MPEG 2 Video Control Control Data Trans Quant Coeff IQ IT Decoder Entropy Coding 0 Motion compensation Inter Intra MV AVS Tutorial Motion estimation Oct 20 2004 8 AVS Video Version 1 AVS HD Control Control Data Trans Quant Coeff IQ IT Decoder Entropy Coding Intraframe Prediction Deblock Motion compensation Inter Intra MV AVS Tutorial Motion estimation Oct 20 2004 9 AVS Video Version 1 AVS HD Control Control Data Trans Quant Coeff IQ IT Decoder Entropy Coding Intraframe Prediction Deblock Motion compensation Inter Intra MV AVS Tutorial Motion estimation Oct 20 2004 10 Profile and Level JiZhun Profile Dec 2003 4 level 4 0 4 2 6 0 6 2 up to Standard Definition with 4 2 0 up to Standard Definition with 4 2 2 up to High Definition with 4 2 0 up to High Definition with 4 2 2 X Profile 2005 AVS Tutorial Oct 20 2004 11 AVS Video 1 0 Tools AVS video 1 0 accepted 42 technical proposals from more than 200 Major tools Transform 16bit implemented 8x8 integer transform Quantization and scaling scaling only in encoder Intra prediction 5 modes Motion compensation 16x16 16x8 8x16 8x8 modes Quarter pel interpolation 4 taps interpolation filter Deblocking Entropy coding Minor tools Motion vector prediction Skipped mode and Coded block pattern Adaptive scan AVS Tutorial Oct 20 2004 12 Bit Stream Structure Sequence Frame Slice Macroblock Block Block size 8x8 based A B C D E F G H I J AVS Tutorial Oct 20 2004 13 Basic Block Size 8x8 vs 4x4 Mother Sequence Foreman Coastguard Container Daughter Size 176 144 176 144 176 144 176 144 QCIF PSNR dB 0 16 0 02 0 91 0 53 0 394 Rate 0 04 0 01 0 20 0 12 Mother 0 0882 Sequence Foreman Coastguard Container Daughter Size 352 288 352 288 352 288 352 288 CIF PSNR dB 0 063 0 386 0 363 0 192 0 058 Rate 1 56 9 77 9 93 5 05 1 6925 Sequence Tempete Mobile Flowergarden Football Size 352 288 352 288 352 240 352 240 PSNR dB 0 185 0 767 0 493 0 231 Rate 4 5 17 54 8 93 4 15 Sequence Tempete Mobile Flowergarden Football Size 720 480 720 576 720 576 720 576 CCIR PSNR dB 0 009 0 442 0 197 0 147 0 121 Rate 0 24 40 34 3 82 2 67 10 313 Sequence Night City Crew Harbour SIF 0 419 8 78 Size 1280 720 1280 720 1280 720 1280 720 HD p PSNR dB 0 092 0 144 0 27 0 46 0 2024 Rate 2 85 5 9 12 12 8 6 564 Sequence Spin Calendar Flamingo Fireworks Kayak Size 1280 720 1920 1088 1920 1088 1920 1088 HD I PSNR dB 0 046 0 286 0 32 0 519 0 1617 Rate 3 05 5 46 5 19 8 53 2 933 AVS Tutorial Oct 20 2004 JM5 0 4x4 Transform Intra Inter pred all modes enabled 8x8 Transform Intra Inter pred modes no smaller then 8x8 enabled 14 Picture Type I B B P B B P Picture type I frame P frame at most 2 reference frames B frame 2 reference frames AVS Tutorial Oct 20 2004 15 Intra frame Prediction and Compensation AVS Tutorial Oct 20 2004 16 Intra Prediction Modes 8x8 based Luma 5 modes r c 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 1 0 Intra 8x8 Vertical 1 Intra 8x8 Horizontal 2 Intra 8x8 DC 3 Intra 8x8 Down Left 4 Intra 8x8 Down Right 2 3 4 3 5 6 7 8 1 9 Chroma 4 modes 10 0 Intra Chroma DC 1 Intra Chroma Horizontal 2 Intra Chroma Vertical 3 Intra Chroma Plane AVS Tutorial 0 Oct 20 2004 11 12 13 3 0 4 14 15 16 17 Luma Vertical Horizontal Mode Intra 8x8 Vertical Intra 8x8 Horizontal R0 R8 R0 R8 C0 C8 C0 C8 Horizontal AVS Tutorial Vertical Oct 20 2004 18 Luma DC Mode r x r x 1 r x 2 R0 R16 Intra 8x8 DC C x C x 1 C x 2 preMatrix x y The prediction for each pixel is different Low pass filter C0 C16 AVS Tutorial Oct 20 2004 19 Luma Down Left Down Right Mode Only if r i c i i 1 16 all available use these two mode Intra 8x8 Down Left left Intra 8x8 Down Right right r x 1 r x r x 1 r x r x 1 r x 2 R0 R16 R0 R16 Case 2 x y C y 1 C y C y 1 C x C x 1 C x 2 Case 1 x y preMatrix x y Case 3 x y C0 C16 C0 C16 AVS Tutorial Oct 20 2004 20 …