Slide 1Slide 2Slide 3Slide 4Slide 5Slide 6Slide 7Slide 8Slide 9Slide 10Slide 11Slide 12Slide 13A New Coding Mode for Error Resilient VideoEE368C Final PresentationStanford UniversitySangoh JeongMar.8, 2001OutlineOutlineUse of Leaky Prediction + RD theory for Improved Error ResiliencyGeneral Hybrid Video CodecProposed New Coding ModeRD-Based Mode SelectionExperimental EnvironmentResultsData UnitsData UnitsGOB(Group Of Block)s, MB(Macroblock)s and Blocks- Example : For QCIF(9GOBs),176 (11MBs) 144(9GOBs)QCIF picture0178161688MBsYCrCbGOB #12345 6BlockGeneral Hybrid Video CodecGeneral Hybrid Video CodecDCTIQMC+Q IDCTMEFrameMemoryCurrent MBSearch AreaMVInput VideoIntraInterMCed MBPeCompressed BitsteamEncoderIQMC IDCTFrameMemoryMVInterDecoded VideoCompressed BitsteamIntraDecoderThe Leaky-Inter ModeThe Leaky-Inter Mode Prediction Error Leaky Prediction•Attenuates the energy of the prediction signal•Superimposed errors decay over time•Encoding of : Intra , Inter Reconstructed Frame Original FrameMB1MB210,21 MBMBpe0pe1RD-Based Mode DecisionRD-Based Mode DecisionCost Function & Decision Process•Intra Mode :•Inter Mode :•Leaky-Inter Mode :•Value of :InterInterInterRDJIntraIntraIntraRDJInterLInterLInterL RDJ  285.0 QP Find the Reconstructed FrameCompute the DistortionCompute the Rate InvolvedCompute the Cost Choose the Mode with the Minimum CostEncoder SetupEncoder SetupDCTIQMC+Q IDCTMEFrameMemory 1Current MBSearch AreaMVInput VideoIntraInterRD-Based Coding ControlMCed MB1PeIQ IDCTFrameMemory 2GOBs loss and concealmentFeedbackNo FeedbackMCed MB2Encoder and ExperimentEncoder and Experiment Encoder Software Used•H.263 Encoder V2.0 (TMN-8)•RD-Based Mode Decision Realized for Experiment Error Resiliency Experiment•Effect of Leaky-Inter Mode - Case1 : Operation Without Errors, regarding values - Case2 : Operation With Errors, regarding values•Effect of Leaky-Inter Mode with Assumed Feedback - 3-Mode Operation with Errors, regarding an Conditions on ExperimentConditions on ExperimentThe Pattern of Errors•GOB Loss rate : 6.67% : Random Burst Loss of 3 GOBs / 5(average) decoded frames.•Same positions of errors applied to all experiments For ComparisonAssumption•Encoder knows the state of the decoder accuratelyError Concealment•GOB Concealment from Previous Frame for ErrorsL-Inter & Intra ResultL-Inter & Intra ResultL-Inter & Intra Result (Error case)L-Inter & Intra Result (Error case)Resiliency in case of FeedbackResiliency in case of FeedbackConclusion & Future WorkConclusion & Future Work Improved resiliency  Less coding efficiency Not so helpful with accurate feedback  Further Experiment• Encoder knows only the region of errors of the decoded video as feedback information• Encode the region of errors with the Leaky-Inter Mode  Future work• Find the leaky-coefficient( ) methodically• Experiment with realistic transmission