1Lecture 10 Part 2 Grid/MetacomputingGraham E FaggCS 594 Spring 2003Lecture 10 part 2? The updates and other systems? Unicore? Globus 2.0/2.2b? A little on XML? Globus 3 or Open Grid Services Architecture (OGSA)UNICORE Slides courtesy of Edgar GabrielHigh Performance Computing CenterStuttgartUNICORE outline? Concept? Submission of a simple job? UNICORE-pluginsUNICORE ? Uniform Interface to COmputing Resources? Goals:? Seamless, secure and intuitive access to HPC resources? Consistent batch access to different remote systems? Support existing and emerging technologies? Minimal intrusion into the centers? Support multi-system and multi-site applicationsUNICORE status? Current version: 3.6? Version 4.0 available at the end of the year? Licensing:? Protocol will be publicly available? Distribution and support by Pallas GmbH? Free download of test system at:http://www.fz-juelich.de/unicore-test2PartnerForschungszentrumJülich Pallas GmbH DeutscherWetterdienst Leibniz-RechenzentrumMünchen University ofKarlsruhe Technical University of DresdenUniversität-GHPaderborn Rechenzentrum derUniversität Stuttgart Konrad-Zuse-Zentrum Berlin JPA (Job Preparation Agent)Batch subsystem via TSIUNICORE ServerGatewayNetwork Job Supervisor(NJS)SSLOther servers (e.g. SAFE)Other client (e.g. NIFTI)Target system access mechanism (e.g. SSH)UNICORE Acronyms? Usite: a site providing UNICORE services (e.g. HLRS)? Vsite: computing resources (e.g. a single computer, an SMP or a cluster)? Uspace: dedicated file space on the target system; may only exist during the execution of the job? Xspace: permanent storage on the execution system (e.g. home, file-server)? Nspace: file system on the local computer, where the client is runningJob Submission SupercomputerJPA (Job Preparation Agent)GatewayNetwork Job Supervisor(NJS)SSLwww.unicore.deHTTPTrustedCAsUUDBIDBTSISocket/SSLSocketUSpaceIs user Cert signed by trusted CAMap CERT to Unix LoginMake generic job machine specificJob Storage SpaceMulti-site JobsUNICORE GUI[Plug-in]BatchsystemBatchsystemBatch subsystem via TSIUNICORE ServerGatewayNetwork Job SupervisorUNICORE Site 1BatchsystemBatchsystemBatch subsystem via TSIUNICORE ServerGatewayNetwork Job SupervisorUNICORE Site nSSLTCP/IP TCP/IPwww.unicore.deHTTPSSLJPA/JMC screenshot3A script job - script editor A script job - options A script job - file imports and exports Job MonitoringTechnical Details (I)? Client is implemented in Java? The protocol is implemented in two layers? Unicore Protocol Layer (UPL)Simple Request/Response Protocol realized with serialized Java Objects? Abstract Job Objects (AJO) model Jobs such as a Script Task in a generic way are transmitted as serialized Objects within UPL RequestsTechnology Details (II)UPL RequestScript TaskSignatureSSLTCP/IP10010010001111110...SerializeUPL RequestScript TaskSignatureDeserialize4UNICORE File Transfer (FTM)Storage ServerNIFTI GatewaySecure Access File Executive(SAFE)SSLTrustedCAsUUDBSocket/SSLRSH/SSH with suexecIs user Cert signed by trusted CAMap CERT to Unix LoginXSpaceTechnical Details (FTM)? Architecturally integrated with the rest of the UNICORE software? Protocol is also based on serialized Java Objects? Due to different nature of file transfer commands the protocol is a multi stage protocol (not UPL)? Will use the same GatewayUNICORE plug-in mechanism• Application-specific support in UNICORE• Currently planned/supported plug-in:• CPMD• Fluent• STAR-CD• Nastran• Gaussian• ...Graphical Plugin Integration (1)Source: Ralf Ratering, Pallas GmbHGraphical Plugin Integration (2)? Menu ItemsSource: Ralf Ratering, Pallas GmbHGraphical Plugin Integration (3)? Menu Items? Representationin Job EditorSource: Ralf Ratering, Pallas GmbH5Graphical Plugin Integration (4)? Menu Items? GUI? Representatio in Job EditorSource: Ralf Ratering, Pallas GmbHGraphical Plugin Integration (5)? Menu Items? GUI? Representationin Job Editor? Representationin Job MonitorSource: Ralf Ratering, Pallas GmbH? Download plugin jar archive and store in plugin directory.UserClientSoftwareWebsiteHandling of plugins for users (1)Plugin XYPluginJar ArchiveSource: Ralf Ratering, Pallas GmbHHandling of plugins for users (2)UserClientSoftwarePlugin XY2.Is the plugin author trustworthy?Source: Ralf Ratering, Pallas GmbHHandling of plugins for users (3)3.Editing the plugin parameters.UserClientSoftwarePlugin XYSource: Ralf Ratering, Pallas GmbHHandling of plugins for users (4)4.Will the selected virtual site support the plugin?UserVirtual SiteSoftware Resource:Plugin XYClientSoftwarePlugin XYRequestSource: Ralf Ratering, Pallas GmbH6Handling of plugins for users (5)5.Submit the job.UserVirtualSubmit Job containing Plugin tasksClientSoftwarePlugin XYSource: Ralf Ratering, Pallas GmbHMore information? UNICORE Web-site: http://www.fz-juelich.de/unicoreplus? UNICORE-Forum: http://www.unicore.org? Contact: [email protected]? Support: [email protected]? Documentation:? UNICORE Client description (56 pages)? UNICORE Client Plugins - Programmers Guide Version 3.6 (13 pages)? Installation guides to all components availableFuture of UNICORE? Eurogrid? European UNICORE based testbed for three application areas? GRIP? interoperability between UNICORE and Globus? Convergence towards OGSA (Open Grid Software Architecture)Globus 2.0b/2.2? Many Bug fixes? API changes hence 1.X to 2.X? Improved packaging via gpt? Think of rpms for Grids? Component improvements? Architecture changes ? MDS->GRIS/GIIS no need to start LDAP root at ANL? GSI is simpler (see etc/grid-security)Xml, WSDL and SOAP? OK how do we describe ‘services’ in a portable way?? How do we describe data in a way that everybody understands?? How do we then transfer the data invoke the service Xml, WSDL and SOAP? Why use XML/SOAP?? Agreed way of describing something? But, just because we agree on the language we use does not mean we agree on what it means..? Hence the OGSA spec.7HARNESS XML/SOAP example? Example getCount? This function is a C shared object, takes a ASCII name and associates that with a counter that can be controlled using that name.? DescriptionHARNESS XML/SOAP example<?xml version="1.0" encoding="UTF-8"?><definitions
View Full Document
Unlocking...