UB CSE 486 - An Overview of Grid Computing and its Impact on Information Technology

Unformatted text preview:

An Overview of Grid Computing and its Impact on Information TechnologyTopics for DiscussionHow did we get here?Beginnings of The GridCondor High Throughput Computing (HTC) (1996 –Scientific ApplicationsIssuesWeb Services StandardGrid OrganizationsGrid TechnologyTypes of GridService-oriented StandardsOGSA, OGSI and WSFeatures of Grid ServiceSample Grid Service: NotificationNotification ExplainedHigher Level Grid ConceptsVirtualizationVirtual OrganizationApplication: Tax Return Filer01/14/19 B. Ramamurthy 1An Overview of Grid Computing and its Impact on Information TechnologyBina RamamurthyBina RamamurthyPartially Supported by NSF DUE CCLI A&I Grant 031147301/14/19 B. Ramamurthy 2Topics for DiscussionThe beginningsThe scientific problems and high performance computing (HPC)The Condor gridThe Globus grid01/14/19 B. Ramamurthy 3How did we get here?Time (years)1970 1980 1990 2000scaleEUNETMILNETSpeedNumber of hostsDefense:ARPANETAcademic Research:NSFNETWeb applicationInternet CommercializationSearch;Social networkingUnstructuredcontentVirtualization;Cloud computing01/14/19 B. Ramamurthy 4Beginnings of The Grid Beginnings of the grid in Search for Extra Terrestrial Intelligence (seti@home project)http://planetary.org/html/UPDATES/seti/index.htmlThe Wow signal http://planetary.org/html/UPDATES/seti/SETI@home/wowsignal.htmlCondor High Throughput Computing (HTC) (1996 –Large collections of distributed heterogeneous computing resources.Use of unused cycles in general purpose systems HTC is effective management and exploitation of all available computing resources. For scientific applications requiring lots of flopsURL: http://www.cs.wisc.edu/condor/htc.htmlKeeps track of resources; schedules them on demandDistributed ownership of resources01/14/19 B. Ramamurthy 5Scientific ApplicationsNational Fusion collaboratory: http://arxiv.org/ftp/cs/papers/0301/0301033.pdfGlobus Toolkit (GT)Argonne National labIntroduced grid servicesGT2 C-basedGT3 Java/OO basedGT4 WS based –lead to unification to W3C’s WS standard01/14/19 B. Ramamurthy 601/14/19 B. Ramamurthy 7 IssuesModernizing legacy systemsWeb-enabling business servicesAutomating business processesIntegration within organizationData and application integration Collaboration with outside organizationsSecurity, accountability, availability, reliability, …01/14/19 B. Ramamurthy 8Web Services StandardA common operation on the Internet is search, the results of which is consumed by humans.Develop complex multi-business applications that are beyond the current search-type applicationsWebservices (WS) is a standard that has been introduced by W3 consortium to address this important transition.Grid takes the web services to the next level: a grid service (GS) is a web service.Grid/GS……Web/WS...... InternetTechnology Pipeline01/14/19 B. Ramamurthy 9Grid OrganizationsThe Globus Alliance: www.globus.orgconducts research and development to create fundamental technologies behind the "Grid," which lets people share computing power, databases, and other on-line tools securely across corporate, institutional, and geographic boundaries without sacrificing local autonomy.L01/14/19 B. Ramamurthy 10Grid Technology Natural evolution of distributed systems and the Internet.Middleware supporting network of systems to facilitate sharing, standardization and openness.Infrastructure and application model dealing with sharing of compute cycles, data, storage and other resources.NSF supported Tera-gridPublicized by prominent industries as on-demand computing, utility computing, etc.01/14/19 B. Ramamurthy 11Types of GridBatch-oriented1. High performance applications2. High Throughput applications3. Example: CondorService-Oriented 1. View all the resources and functions as services.2. Build application models around services.3. Anatomy of the grid 4. Physiology of the grid 5. Example: Globus01/14/19 B. Ramamurthy 12Service-oriented StandardsOpen Grid Services Architecture (OGSA)Open Grid Services Infrastructure (OGSI)Globus Toolkit (GT3) is a reference implementation01/14/19 B. Ramamurthy 13OGSA, OGSI and WSOGSI has been replaced by WSRF (WS Resource Framework)01/14/19 B. Ramamurthy 14Features of Grid Service SecurityRoutingPersistenceServiceDataNotificationLoggingBasic ServiceLogger object; Levels of logging:Info, .. Warn, Error, FatalFiltering and redirecting to file, consoleStores service properties andStates; for discovery, monitoring,negotiations, etc. Provides notification of eventsPermanent services such as naming service thatget activated and terminated with the container…Services with abilityto migrateProvidesStandard security01/14/19 B. Ramamurthy 15Sample Grid Service: NotificationFoundational concepts: messaging, queues, source and sink for messages, subscription model, loose coupling, push and pull notificationGrid related concepts: Service data element (SDE), OGSINotification APIImplement a service that is a producer of notification.Implement a client application that invokes a service that produces notification; an associated listener that consumes the notification. Extend the application to illustrate push and pull model.01/14/19 B. Ramamurthy 16Notification ExplainedGrid ServiceGrid ServiceService Data Element (SDE)Service Data Element (SDE)Server ClientClient ApplicationGS Listener3: notifyChange()2: invoke method1: subscribe to notification 4: process notification Notes: Example: Grid service (GS) can be a Math Service with notifyChange to SDE on invocation of add Subtract methods.GWSDL file: extends=“ogsi”: GridServiceogsi:NotificationSource (declarative vs programmatic)Listener has: NotificationSinkManager to which is added a listener to Math Service’s GSH and SDE.Listener has deliveryNotification() method to process notification.01/14/19 B. Ramamurthy 17Higher Level Grid ConceptsVirtualization of services and resourcesFederation of DataProvisioningLifecycle ManagementVirtual OrganizationOrchestration of servicesChoreography of servicesWeb Services Orchestration and Choreography01/14/19 B. Ramamurthy 18VirtualizationEncapsulating service operations behind a common message-oriented service interface is called service virtualization.Isolates users from details of service implementation and location.Assumes support of a standard architecture.Webservices (WS) can do this, however grid life cycle management, fault handling and other features we have seen in the GT3 tutorial are not


View Full Document

UB CSE 486 - An Overview of Grid Computing and its Impact on Information Technology

Download An Overview of Grid Computing and its Impact on Information Technology
Our administrator received your request to download this document. We will send you the file to your email shortly.
Loading Unlocking...
Login

Join to view An Overview of Grid Computing and its Impact on Information Technology and access 3M+ class-specific study document.

or
We will never post anything without your permission.
Don't have an account?
Sign Up

Join to view An Overview of Grid Computing and its Impact on Information Technology 2 2 and access 3M+ class-specific study document.

or

By creating an account you agree to our Privacy Policy and Terms Of Use

Already a member?