On Multimedia Technology & Infrastructure for Emerging Applications: from Desktop to Wireless to Peer-to-PeerAcknowledgements*Ubiquitous Multimedia Wired and WirelessDigital Media: from desktop, to Internet, to hand-helds, to wireless, and to Peer-to-PeerInequality: compute, bandwidth, storage and displayChallengesMultimedia dataP2P for MultimediaMAPS: Media Accelerating Peer ServicesSystem ArchitectureSystem ComponentsMinimal Cost to Deliver a Resource to a Peer NodeCost AnalysisMinimal Cost to Perform a computationCost Computation & EstimationMethodology for Estimating End-to-End Computing Performance and Analyzing Network Computing ModelsOverviewSample Results: Computation DistributionSample Results: Quality as a Performance MetricMultimedia SupportIntel MPL - Media Processing Library (presented at IDF Fall’99, Fall’00)PowerPoint PresentationReference: MPL featuresSlide 24Slide 25MPL Next StepsFacilitating Multimedia SearchContent analysis & SearchOn Compact Representations & Fast SearchSlide 30Building MAPS into a P2P computing platformPrototype systemSeamless Multimedia for Dynamic and Heterogeneous EnvironmentPeer Media ExplorerExtending Multimedia Apps and Technology from Desktop to P2PStreaming, sharing and collaborating on digital mediaBuilding BlocksWireless Multimedia: Robust Video Delivery over Wireless Networks (IP, Bluetooth, and beyond)Looking forward…More on Intel MRL Media ResearchAugmenting Research via University Collaboration & PartnershipsSummer Internships @ Intel MRLCopyright © 2001 Intel Corporation.On Multimedia Technology & On Multimedia Technology & Infrastructure for Emerging Applications:Infrastructure for Emerging Applications:from Desktop to Wireless to Peer-to-Peerfrom Desktop to Wireless to Peer-to-PeerMinerva M. Yeung, Ph.D.Minerva M. Yeung, Ph.D.<[email protected]><[email protected]>Media Technology ResearchMedia Technology Research Microprocessor Research LabsMicroprocessor Research LabsIntel Corporation.Intel Corporation.Feb 20, 2001.Feb 20, 2001.Stanford SeminarStanford SeminarCopyright © 2001 Intel Corporation.Copyright © 2001 Intel Corporation. M. Yeung, 2/20.Page 2IntelMedia TechnologyMRL/TRLPage 2IntelMedia TechnologyMRL/TRLAcknowledgements*Acknowledgements*Yen-Kuang Chen, Yen-Kuang Chen, Ph.D.Ph.D.Matthew HollimanMatthew HollimanRainer Lienhart, Rainer Lienhart, Ph.D.Ph.D.Skip Macy, Skip Macy, Ph.D.Ph.D.Igor Kozintsev, Igor Kozintsev, Ph.DPh.DAndre Zaccarin, Andre Zaccarin, Ph.D.Ph.D.Valery Kuriakin and the iNNL-MPL teamValery Kuriakin and the iNNL-MPL team (Russia)(Russia)And many othersAnd many others* Key collaborators/contributors to the work mentioned in the talk. * Key collaborators/contributors to the work mentioned in the talk.Copyright © 2001 Intel Corporation.Copyright © 2001 Intel Corporation. M. Yeung, 2/20.Page 3IntelMedia TechnologyMRL/TRLPage 3IntelMedia TechnologyMRL/TRLUbiquitous MultimediaUbiquitous MultimediaWired and WirelessWired and WirelessInteractive, High Performance, Interactive, High Performance, Enriched MediaEnriched MediaCopyright © 2001 Intel Corporation.Copyright © 2001 Intel Corporation. M. Yeung, 2/20.Page 4IntelMedia TechnologyMRL/TRLPage 4IntelMedia TechnologyMRL/TRLDigital Media: from desktop, to Internet, to Digital Media: from desktop, to Internet, to hand-helds, to wireless, and to Peer-to-Peerhand-helds, to wireless, and to Peer-to-Peer Edge serverEdge serverData Farms / StorageWeb ServerApps/DB ServerE-Commerce ServerMedia ServerWireless Comm ServerCopyright © 2001 Intel Corporation.Copyright © 2001 Intel Corporation. M. Yeung, 2/20.Page 5IntelMedia TechnologyMRL/TRLPage 5IntelMedia TechnologyMRL/TRLInequalityInequality: compute, bandwidth, : compute, bandwidth, storage and displaystorage and displayPlatformPlatformCPUCPUMemoryMemoryStorageStorageB/WB/WScreenScreenServerServerMultipleMultiple1GHz+1GHz+2GB2GB100G to 100G to TerabytesTerabytes1+ Gbps1+ GbpsN/AN/APCPCSingleSingle1GHz+1GHz+256M256M40G40G100 Mbps100 Mbps1600 x 12001600 x 1200LaptopLaptop600 MHz600 MHz128M128M10G10G100 Mbps100 Mbps1024 x 7681024 x 768Media Media PDAPDA200MHz200MHz16M16M8M8M19.219.2kbpskbps320 x 240320 x 240PDAPDA70MHz70MHz8M8M8M8M19.2 kbps19.2 kbps160 x 160160 x 160Implications:Implications:– Blurring of Core vs. EdgeBlurring of Core vs. Edge– Migration from client-server to peer-to-peer frameworkMigration from client-server to peer-to-peer framework– Where should data come from?Where should data come from?– Where should computations be done?Where should computations be done?–Optimal partitioning of computationsOptimal partitioning of computationsCopyright © 2001 Intel Corporation.Copyright © 2001 Intel Corporation. M. Yeung, 2/20.Page 6IntelMedia TechnologyMRL/TRLPage 6IntelMedia TechnologyMRL/TRLChallengesChallengesWhat is the optimal multimedia What is the optimal multimedia content distribution mechanism?content distribution mechanism?What is the optimal multimedia What is the optimal multimedia processing methodology?processing methodology?What are the technology building What are the technology building blocks?blocks?Copyright © 2001 Intel Corporation.Copyright © 2001 Intel Corporation. M. Yeung, 2/20.Page 7IntelMedia TechnologyMRL/TRLPage 7IntelMedia TechnologyMRL/TRLMultimedia dataMultimedia dataSame content can exist in different Same content can exist in different resolutions, bit rate and qualityresolutions, bit rate and qualityCan be gracefully degradedCan be gracefully degradedCan be transformed to multiple Can be transformed to multiple representationsrepresentationsCopyright © 2001 Intel Corporation.Copyright © 2001 Intel Corporation. M. Yeung, 2/20.Page 8IntelMedia TechnologyMRL/TRLPage 8IntelMedia TechnologyMRL/TRLP2P for MultimediaP2P for MultimediaMaintain key features and extendMaintain key features and extend–Supports traditional Supports traditional (existing)(existing) file sharing systems file sharing systems–Facilitates sharing of resources like CPU cycles, storage, Facilitates sharing of resources like CPU cycles, storage, computation process or arbitrary functionalities that can be computation process or arbitrary functionalities that can be abstracted by the user as resources.abstracted by the user as resources.Facilitates exchange of data with real time Facilitates exchange of data with real time requirements, exemplified by video or audio requirements, exemplified by video or audio