DOC PREVIEW
U of I CS 525 - Advanced Distributed Systems

This preview shows page 1-2-3-18-19-36-37-38 out of 38 pages.

Save
View full document
View full document
Premium Document
Do you want full access? Go Premium and unlock all 38 pages.
Access to all documents
Download any document
Ad free experience
View full document
Premium Document
Do you want full access? Go Premium and unlock all 38 pages.
Access to all documents
Download any document
Ad free experience
View full document
Premium Document
Do you want full access? Go Premium and unlock all 38 pages.
Access to all documents
Download any document
Ad free experience
View full document
Premium Document
Do you want full access? Go Premium and unlock all 38 pages.
Access to all documents
Download any document
Ad free experience
View full document
Premium Document
Do you want full access? Go Premium and unlock all 38 pages.
Access to all documents
Download any document
Ad free experience
View full document
Premium Document
Do you want full access? Go Premium and unlock all 38 pages.
Access to all documents
Download any document
Ad free experience
View full document
Premium Document
Do you want full access? Go Premium and unlock all 38 pages.
Access to all documents
Download any document
Ad free experience
View full document
Premium Document
Do you want full access? Go Premium and unlock all 38 pages.
Access to all documents
Download any document
Ad free experience
Premium Document
Do you want full access? Go Premium and unlock all 38 pages.
Access to all documents
Download any document
Ad free experience

Unformatted text preview:

CS 525 Advanced Distributed Systems Spring 2010Clouds are Water VaporThe Hype!Slide 4$$$Slide 6What is a Cloud?Slide 8A Sample Cloud TopologyScale of Industry DatacentersSlide 11Slide 12Slide 13Slide 14Trends: TechnologyTrends: UsersPropheciesSlide 18What(’s new) in Today’s Clouds?I. On-demand access: *aaS ClassificationII. Data-intensive ComputingIII. New Cloud Programming ParadigmsSlide 23Two Categories of CloudsAcademic CloudsCloud Computing Testbed (CCT)CCT Hardware in more DetailGoal of CCT: Support both Systems Research and Applications Research in Data-intensive Distributed ComputingCCT Software ServicesSlide 30Slide 31Slide 32Slide 33Slide 34Slide 35Next WeekAdministrative AnnouncementsAnnouncements (contd.)11Yeah! That’s what I’d like to know.Indranil Gupta (Indy)Lecture 2What(’s in) the Cloud?January 21, 2010CS 525 Advanced Distributed SystemsSpring 2010All Slides © IG2Clouds are Water Vapor•Oracle has a Cloud Computing Center.•And yet…•Larry Ellison’s Rant on Cloud Computing233The Hype!•Gartner - Cloud computing revenue will soar faster than expected and will exceed $150 billion within five years.•Forrester - Cloud-Based Email Is Often Cheaper Than On-Premise Email •Vivek Kundra, CTO of Obama Government: “Growing adoption of cloud computing could improve data sharing and promote collaboration among federal, state and local governments.” E.g: fedbizopps.gov•Merrill Lynch: “By 2011 the volume of cloud computing market opportunity would amount to $160bn, including $95bn in business and productivity apps (email, office, CRM, etc.) and $65bn in online advertising.”•IDC: “Spending on IT cloud services will triple in the next 5 years, reaching $42 billion and capturing 25% of IT spending growth in 2012.”Sources: http://www.infosysblogs.com/cloudcomputing/2009/08/the_cloud_computing_quotes.htm and http://www.mytestbox.com4Ha ha hype! It’s a bunch of tripe, since no one is probably making or saving money.5$$$•Ingo Elfering, Vice President of Information Technology Strategy, GlaxoSmithKline:“With Online Services, we are able to reduce our IT operational costs by roughly 30% of what we’re spending now and introduce a variable cost subscription model for these technologies that allows us to more rapidly scale or divest our investment as necessary as we undergo a transformational change in the pharmaceutical industry”•Jim Swartz, CIO, Sybase: “At Sybase, a private cloud of virtual servers inside its data centre has saved nearly $US2 million annually since 2006, Swartz says, because the company can share computing power and storage resources across servers.”•Dave Power, Associate Information Consultant at Eli Lilly and Company: “With AWS, Powers said, a new server can be up and running in three minutes (it used to take Eli Lilly seven and a half weeks to deploy a server internally) and a 64-node Linux cluster can be online in five minutes (compared with three months internally). The deployment time is really what impressed us. It's just shy of instantaneous."Sources: http://www.infosysblogs.com/cloudcomputing/2009/08/the_cloud_computing_quotes.htm and http://www.mytestbox.com6Alright, alright. But for heaven’s sake, can someone tell me what is a cloud?7What is a Cloud?•It’s a cluster! It’s a supercomputer! It’s a datastore!•It’s superman!•None of the above•All of the above•Cloud = Lots of storage + compute cycles nearby8What is a Cloud?•A single-site cloud (aka “Datacenter”) consists of–Compute nodes (split into racks)–Switches, connecting the racks–A network topology, e.g., hierarchical–Storage (backend) nodes connected to the network–Front-end for submitting jobs–Services: physical resource set, software services•A geographically distributed cloud consists of–Multiple such sites–Each site perhaps with a different structure and services9A Sample Cloud TopologyTop of the Rack SwitchCore SwitchServersRack10Scale of Industry Datacenters•Microsoft [NYTimes, 2008]–150,000 machines–Growth rate of 10,000 per month–Largest datacenter: 48,000 machines–80,000 total running Bing•Yahoo! [Hadoop Summit, 2009]–25,000 machines–Split into clusters of 4000•AWS EC2 (Oct 2009)–40,000 machines–8 cores/machine•Google–(Rumored) several hundreds of thousands of machines11OK, they are massive. But it is still called a “cluster”! And that’s not a new concept!121940195019601970198019902000Timesharing Companies & Data Processing Industry 2010GridsPeer to peer systemsClustersThe first datacenters!PCs(not distributed!)Clouds and datacenters“A Cloudy History of Time” © IG 201013Timesharing Industry (1975):•Market Share: Honeywell 34%, IBM 15%, •Xerox 10%, CDC 10%, DEC 10%, UNIVAC 10%•Honeywell 6000 & 635, IBM 370/168, Xerox 940 & Sigma 9, DEC PDP-10, UNIVAC 1108Grids (1980s-2000s):•GriPhyN (1970s-80s)•Open Science Grid and Lambda Rail (2000s)•Globus & other standards (1990s-2000s)First large datacenters: ENIAC, ORDVAC, ILLIACMany used vacuum tubes and mechanical relaysP2P Systems (90s-00s)•Many Millions of users•Many GB per dayData Processing Industry - 1968: $70 M. 1978: $3.15 Billion.Berkeley NOW ProjectSupercomputersServer Farms (e.g., Oceano)“A Cloudy History of Time” © IG 2010Clouds14Why did all of this happen?15Trends: Technology•Doubling Periods – storage: 12 mos, bandwidth: 9 mos, and (what law is this?) cpu speed: 18 mos•Then and Now Bandwidth–1985: mostly 56Kbps links nationwide–2004: 155 Mbps links widespreadDisk capacity–Today’s PCs have 100GBs, same as a 1990 supercomputer16Trends: Users•Then and Now Biologists: –1990: were running small single-molecule simulations –2004: want to calculate structures of complex macromolecules, want to screen thousands of drug candidates, sequence very complex genomesPhysicists–2008 onwards: CERN’s Large Hadron Collider will produce 700 MB/s or 15 PB/year•Trends in Technology and User Requirements: Independent or Symbiotic?17PropheciesIn 1965, MIT's Fernando Corbató and the other designers of the Multics operating system envisioned a computer facility operating “like a power company or water company”.Plug your thin client into the computing Utilityand Play your favorite Intensive Compute &Communicate Application–[Have today’s clouds brought us closer to this reality?]18So, clouds have been around for decades! But aside from massive scale what’s new about


View Full Document

U of I CS 525 - Advanced Distributed Systems

Documents in this Course
Epidemics

Epidemics

12 pages

LECTURE

LECTURE

7 pages

LECTURE

LECTURE

39 pages

LECTURE

LECTURE

41 pages

P2P Apps

P2P Apps

49 pages

Lecture

Lecture

48 pages

Epidemics

Epidemics

69 pages

GRIFFIN

GRIFFIN

25 pages

Load more
Download Advanced Distributed Systems
Our administrator received your request to download this document. We will send you the file to your email shortly.
Loading Unlocking...
Login

Join to view Advanced Distributed Systems and access 3M+ class-specific study document.

or
We will never post anything without your permission.
Don't have an account?
Sign Up

Join to view Advanced Distributed Systems 2 2 and access 3M+ class-specific study document.

or

By creating an account you agree to our Privacy Policy and Terms Of Use

Already a member?