Lecture 10 Part 2 Grid Metacomputing Lecture 10 part 2 Graham E Fagg CS 594 Spring 2003 UNICORE The updates and other systems Unicore Globus 2 0 2 2b A little on XML Globus 3 or Open Grid Services Architecture OGSA UNICORE outline Concept Submission of a simple job UNICORE plugins Slides courtesy of Edgar Gabriel High Performance Computing Center Stuttgart UNICORE Uniform Interface to COmputing Resources Goals Seamless secure and intuitive access to HPC resources Consistent batch access to different remote systems Support existing and emerging technologies Minimal intrusion into the centers Support multi system and multi site applications UNICORE status Current version 3 6 Version 4 0 available at the end of the year Licensing Protocol will be publicly available Distribution and support by Pallas GmbH Free download of test system at http www fz juelich de unicore test 1 Partner Forschungszentrum J lich Rechenzentrum der Universit t Stuttgart Pallas GmbH Universit t GH Paderborn University of Karlsruhe Network Job Supervisor NJS Batch subsystem via TSI Other servers e g SAFE Target system access mechanism e g SSH Job Submission UNICORE Acronyms UNICORE Server Gateway Konrad Zuse Zentrum Berlin Technical University of Dresden Other client e g NIFTI SSL LeibnizRechenzentrum M nchen Deutscher Wetterdienst JPA Job Preparation Agent JPA Job Preparation Agent Usite a site providing UNICORE services e g HLRS Vsite computing resources e g a single computer an SMP or a cluster Uspace dedicated file space on the target system may only exist during the execution of the job Xspace permanent storage on the execution system e g home file server Nspace file system on the local computer where the client is running Multi site Jobs HTTP www unicore de SSL Gateway Socket SSL Network Job Supervisor NJS Socket Is user Cert signed by trusted CA Trusted CAs UUDB IDB Map CERT to Unix Login Make generic job machine specific TSI Supercomputer USpace Job Storage Space JPA JMC screenshot UNICORE GUI Plug in SSL UNICORE Server HTTP www unicore de SSL UNICORE Server Gateway Gateway Network Job Supervisor Network Job Supervisor TCP IP Batchsystem Batchsystem Batch subsystem via TSI TCP IP Batchsystem Batchsystem Batch subsystem via TSI UNICORE Site 1 UNICORE Site n 2 A script job script editor A script job options A script job file imports and exports Job Monitoring Technical Details I Technology Details II Client is implemented in Java The protocol is implemented in two layers Unicore Protocol Layer UPL Simple Request Response Protocol realized with serialized Java Objects Abstract Job Objects AJO model Jobs such as a Script Task in a generic way are transmitted as serialized Objects within UPL Requests Deserialize Serialize Script Task Script Task 10010010001111110 Signature SSL Signature TCP IP UPL Request UPL Request 3 UNICORE File Transfer FTM NIFTI SSL Trusted CAs Gateway Technical Details FTM Is user Cert signed by trusted CA Socket SSL UUDB Secure Access File Executive SAFE Map CERT to Unix Login RSH SSH with suexec XSpace Storage Server UNICORE plug in mechanism Architecturally integrated with the rest of the UNICORE software Protocol is also based on serialized Java Objects Due to different nature of file transfer commands the protocol is a multi stage protocol not UPL Will use the same Gateway Graphical Plugin Integration 1 Application specific support in UNICORE Currently planned supported plug in CPMD Fluent STAR CD Nastran Gaussian Source Ralf Ratering Pallas GmbH Graphical Plugin Integration 2 Graphical Plugin Integration 3 Menu Items Menu Items Representation in Job Editor Source Ralf Ratering Pallas GmbH Source Ralf Ratering Pallas GmbH 4 Graphical Plugin Integration 4 Graphical Plugin Integration 5 Menu Items Menu Items Representatio in Job Editor Representation in Job Editor GUI GUI Representation in Job Monitor Source Ralf Ratering Pallas GmbH Handling of plugins for users 1 Source Ralf Ratering Pallas GmbH Handling of plugins for users 2 Client Software Plugin XY User Client Software Plugin XY Source Ralf Ratering Pallas GmbH User Download plugin jar archive and store in plugin directory 2 Is the plugin author trustworthy Plugin Jar Archive Website Source Ralf Ratering Pallas GmbH Handling of plugins for users 3 Handling of plugins for users 4 Source Ralf Ratering Pallas GmbH User User Source Ralf Ratering Pallas GmbH Client 3 Editing the plugin Software parameters Plugin XY Client Software Plugin XY Request 4 Will the selected virtual site support the plugin Software Resource Plugin XY Virtual Site 5 Handling of plugins for users 5 Source Ralf Ratering Pallas GmbH User Client Software Plugin XY 5 Submit the job Submit Job containing Plugin tasks More information Virtual UNICORE Web site http www fz juelich de unicoreplus UNICORE Forum http www unicore org Contact info pallas com Support unicore support pallas com Documentation Future of UNICORE Eurogrid European UNICORE based testbed for three application areas Globus 2 0b 2 2 GRIP interoperability between UNICORE and Globus Convergence towards OGSA Open Grid Software Architecture Xml WSDL and SOAP OK how do we describe services in a portable way How do we describe data in a way that everybody understands How do we then transfer the data invoke the service Many Bug fixes API changes hence 1 X to 2 X Improved packaging via gpt UNICORE Client description 56 pages UNICORE Client Plugins Programmers Guide Version 3 6 13 pages Installation guides to all components available Think of rpms for Grids Component improvements Architecture changes MDS GRIS GIIS no need to start LDAP root at ANL GSI is simpler see etc grid security Xml WSDL and SOAP Why use XML SOAP Agreed way of describing something But just because we agree on the language we use does not mean we agree on what it means Hence the OGSA spec 6 HARNESS XML SOAP example Example getCount This function is a C shared object takes a ASCII name and associates that with a counter that can be controlled using that name Description HARNESS XML SOAP example xml version 1 0 encoding UTF 8 definitions name Service xmlns http schemas xmlsoap org wsdl xmlns SOAP ENV http schemas xmlsoap org soap envelope xmlns SOAP ENC http schemas xmlsoap org soap encoding xmlns SOAP http schemas xmlsoap org wsdl soap xmlns WSDL http schemas xmlsoap org wsdl xmlns xsd http www w3 org 2001 XMLSchema targetNamespace URL Service wsdl xmlns tns URL Service wsdl xmlns ns1 URL ns1 xsd types schema xmlns http www w3 org
View Full Document
Unlocking...