DOC PREVIEW
USC CSCI 551 - 18_bistro-6up

This preview shows page 1-2-3 out of 10 pages.

Save
View full document
View full document
Premium Document
Do you want full access? Go Premium and unlock all 10 pages.
Access to all documents
Download any document
Ad free experience
View full document
Premium Document
Do you want full access? Go Premium and unlock all 10 pages.
Access to all documents
Download any document
Ad free experience
View full document
Premium Document
Do you want full access? Go Premium and unlock all 10 pages.
Access to all documents
Download any document
Ad free experience
Premium Document
Do you want full access? Go Premium and unlock all 10 pages.
Access to all documents
Download any document
Ad free experience

Unformatted text preview:

1 Computer Communications - CSCI 551 Copyright © William C. Cheng CS551Scalable Wide-areaUpload[Bistro00]Bill Chenghttp://merlot.usc.edu/cs551-f122 Computer Communications - CSCI 551 Copyright © William C. Cheng a Platform for Building ScalableWide-Area Upload Applicationsa Platform for Building ScalableWide-Area Upload ApplicationsBistroBistro3 Computer Communications - CSCI 551 Copyright © William C. Cheng Scalable Data Transfer ApplicationsEnd-system / Application-level# of Receivers# of SendersOneOneManyMany4 Computer Communications - CSCI 551 Copyright © William C. Cheng Scalable Data Transfer ApplicationsEnd-system / Application-level# of Receivers# of SendersOneOneManyManyftptraditional apps...5 Computer Communications - CSCI 551 Copyright © William C. Cheng Scalable Data Transfer ApplicationsEnd-system / Application-level# of Receivers# of SendersOneOneManyManyweb downloadssoftware distributionvideo-on-demandserver push...ftptraditional apps...6 Computer Communications - CSCI 551 Copyright © William C. Cheng Scalable Data Transfer ApplicationsEnd-system / Application-levelchat roomsvideo conferencingmultiplayer games...# of Receivers# of SendersOneOneManyManyweb downloadssoftware distributionvideo-on-demandserver push...ftptraditional apps...7 Computer Communications - CSCI 551 Copyright © William C. Cheng Scalable Data Transfer ApplicationsEnd-system / Application-levelchat roomsvideo conferencingmultiplayer games...Bistro!!# of Receivers# of SendersOneOneManyManyweb downloadssoftware distributionvideo-on-demandserver push...ftptraditional apps...8 Computer Communications - CSCI 551 Copyright © William C. Cheng Who Is Working on Uploads?To the best of our knowledge, there is no existingwork on making many-to-one communication atthe application layer scalable and efficient9 Computer Communications - CSCI 551 Copyright © William C. Cheng What Are Upload Applications?Internet-basedComputingDistanceEducationDigitalDemocracyE-commerceInternet-basedStorageDigitalGovernmentDataWarehousingIRS income tax submissionHard deadlinespaper submissionreal-life eventsNo hard deadlinesInternet-based storageData warehousing10 Computer Communications - CSCI 551 Copyright © William C. Cheng Why is Upload Different?many-to-one data transferdata consumed later (will exploit this)contention for service rather than datareplication of services and resources for a singleevent is expensive, inflexible, & not scalableread vs. writetraditional solution such as replication of data(caching), replacement of data, etc. won’t helpfault tolerance, security11 Computer Communications - CSCI 551 Copyright © William C. Cheng Traditional Approaches(at the application layer)Increase capacitySpread the load ... over time, space, or bothExamplesdata replicationdata replacementservice replicationserver pushftp mirroring, web cachingmulti-resolution images, videoDNS lookup, NTPnews download, software distributionChange the workload12 Computer Communications - CSCI 551 Copyright © William C. Cheng Traditional Approaches (Cont...)Example: AkamaiRelieve web download hotspotsthrough data replication (caching)Use their own network of servers,with strategic placement of serversaround the worldClients include: Microsoft, Paramount, Wired, CBS Sports, Nike, BBC America, Apple, ...Why are there hotspots?real-life events> 2700 servers> 45 countries> 150 networksavailability ofnew data13 Computer Communications - CSCI 551 Copyright © William C. Cheng Our GoalsA single infrastructure (termed Bistro) for alldata collection needsgood performance (for both service providers and users)scalable (shares resources among all service providers) secure (one service provider does not have to trustanother)14 Computer Communications - CSCI 551 Copyright © William C. Cheng Current State of Affairs for UploadingServer...Independent data transfers over the Internet, i.e., TCP/IPTCP/IP shares bandwidth fairlyindividual clients experience poor performancewhen number of clients is large (if transfer timeis long enough to see other connections)TCP/IP is here to stayClientsNot scalable!15 Computer Communications - CSCI 551 Copyright © William C. Cheng Key Observations(applications with deadlines)Existence of hot spots in uploads is largely due toapproaching deadlinesExacerbated by long transfer timesProblem: too much data ... too little time ...Client 1DestinationServerInternetbottleneckClient 2Client 3Client NData 1Data 2Data 3Data N16 Computer Communications - CSCI 551 Copyright © William C. Cheng Key Observations (Cont...)(applications with deadlines)What is actually needed is an assurance that specificdata was submitted before a specific timeThen the transfer of that data needs to be done in a timelymanner, but does not have to occur by the deadlinei.e., we need a commitment of what and when asubmission took placeunlink downloads, the data may not be consumedat the server right awayif a piece of data arrives after the deadline, we justneed to guarantee that it’s exactly the same pieceof data that was committed before the deadline17 Computer Communications - CSCI 551 Copyright © William C. Cheng Solution with BistroBefore deadline:TimeDeadlineTraffic at/near Destination Server:Client 1Client NDestinationServerInternetbottleneckHash(fingerprint)Hashes(fingerprints)Datawith contemporary cryptographytechnology, hash size isconstant (10s of bytes), nomatter how big a document is18 Computer Communications - CSCI 551 Copyright © William C. Cheng A Solution to Upload with Deadlines(b) upload with the Bistro Systemafter Bistro softwareis installed on the Server(a) upload without BistroServerClients...DataFlowDestination bistro(i.e., Server)Clients.........Bistro SystemDataFlowbistrosA bistro can be installed on an IRS server or a tax partner’s serverA bistro is like an e-Post Office, built to handle certified e-submissionsNote:Picutre above is for a single event, e.g., 2005 personal income tax submissionMultiple events may be going on concurrently or overlapping, eachwith a different destination server19 Computer Communications - CSCI 551 Copyright © William C. Cheng A Solution to Upload with DeadlinesDestination bistro issues a timestamped and certified e-ticketA client generates a fingerprint for the document (tax return)Step 1: Real-time fingerprinting & timestamp(b) upload with the Bistro Systemafter Bistro softwareis installed on the Server(a) upload without


View Full Document

USC CSCI 551 - 18_bistro-6up

Download 18_bistro-6up
Our administrator received your request to download this document. We will send you the file to your email shortly.
Loading Unlocking...
Login

Join to view 18_bistro-6up and access 3M+ class-specific study document.

or
We will never post anything without your permission.
Don't have an account?
Sign Up

Join to view 18_bistro-6up 2 2 and access 3M+ class-specific study document.

or

By creating an account you agree to our Privacy Policy and Terms Of Use

Already a member?