CSE 486 Distributed Systems Spring 2010 - 1 - Due: 2/27/2010 by midnight PROJECT 1: DESIGNING AND DEPLOYING A SERVICE-BASED DISTRIBUTED SYSTEMS 1. Purpose: 1. To understand the fundamentals of a distributed systems. 2. To integrate data from diverse sources and to interpolate data. 3. To understand the components, core technologies, architecture and protocols that enable a Web Services-based distributed system. 4. To design and implement a Web Service. 5. To understand the process of preparing and deploying a remote service. 6. To work with a relational database system. 2. Preparation before lab: 1. Read and understand fundamentals of a client/server distributed systems. 2. Read and study the Web Services architecture and associated protocols. 3. Learn the fundamental of a relational database and designing relational tables. You may use MS Access, Oracle 9i (UB CSE Department’s) or any small footprint file-based databases that come bundled with the IDE you may use. Learn to use the application interface to a relational database using embedded SQL and JDBC. a. http://java.sun.com/docs/books/tutorial/jdbc/basics/index.html b. https://wiki.cse.buffalo.edu/services/content/oracle 4. Choose an IDE (Integrated Development Environment) to work with. You may choose to work with Eclispse or Netbeans. Instructions and demos during lecture and recitations will be on Netbeans IDE. a. http://www.netbeans.org (choose version 6 or later). This is available for most operating systems including Mac OS and Linux. b. You may work on your lap top or on project space that will be allocated for you on CSE machines. This project space is accessible from pollux (Solaris) as well as nickelback (Linux) CSE machines. 5. Finally, you must have a clear understanding of a client-server system operation. 3. Web Services Technology: Web Services technology provides a standard means of building a distributed system over the Internet. In simple terms, it provides a means for a sophisticated remote procedure call. The sophistication arises out of the elegant mechanisms it supports for enabling: 1. Various transparencies (platform, language, and hardware) using open standards, 2. Application to application data exchange and interoperability, and 3. Creation of composite web services from a set of simple web services. The significant difference between regular HTTP-based technologies and Web Services is the standardization realized through the XML and SOAP (SOAP and XML over HTTP). Web Services Definition Language (WSDL) is an important standard that allows for consistent definition of services. All these advantages make Web Services technology ideally suited for large-scale enterprise level application integration.CSE 486 Distributed Systems Spring 2010 Web Services specifications are defined by the World Wide Web Consortium (W3C). Many vendors including Sun Microsystems, Oracle and Microsoft (.net) have frameworks for building and deploying Web Services. 4. Assignment: Build a multi-tier distributed system comprising two major sub-systems 1. A simple data acquisition system and 2. A Web Services based web application that processes and serves the data collected. The two sub-systems are loosely coupled via a database. The block diagram of the system you will implement is given in Figure 1. National Weather Service Web Site 1 WeatherInfo Server XML/RSS - 2 - Figure 1: System Model of the Weather Service Distributed System The national weather bureau updates the weather conditions at various cities on its web site (box 1 in Figure 1). You may either use XML feed from weather.com or RSS (XML) feed from weather.gov or any other weather sources. The Server (box 2) streams in the page and parses it for the relevant data and stores it in a persistent storage. Module 2 will parse the XML or RSS feed extract the relevant data and store it in the oracle database. You will have design a suitable relational schema to store the data. You will have collect data for at least 7 days, before you can interpolate the data for future. So module 1 and 2 are time-critical. I expect you to complete these two modules by 2/6/2010. The persistent storage (box 3): You are required to update the code to accumulate the data for a period of over at least 1 week (or any 7 days). You may design the server to be a Weather Web Service Web Client Weather Web Service Container/Server; Intelligence Module Relational Database Oracle 9i/other Http 2One or more other web services: amazon.com, Googlemaps,yahoo.com Http SOAP XML 3654CSE 486 Distributed Systems Spring 2010 - 3 - persistent one that automatically collects the data once every day and persists the data in a database. The data collected should be stored in a relational database (box 3) on Oracle 9i. The daily data collected can be transformed into visually appealing graphics similar to the demo shown in class. In the Web Services part of the system, the data collected in the database will be processed by the server (box 4) for such information as average temperature for a given city, and the temperature on a particular day for a city. The city can be specified by either the text name or zip code. The Web Services client (box 5) will be able to query the server for various information related to the data collected. Your task is to design and implement the complete Web Services-based system indicated by boxes 2, 3, 4 and 5 of Figure 1, and study the operation of the integrated system depicted in Figure 1. Extend the project given above: An additional and important component that weighs heavily for 50% of the project grade is the box 6 and the intelligence module of box 4. In this part, you are required to use the weather information and other (one or more) web services available on the net to generate useful intelligence. An example of this given below: 1. A user inputs “From” and “To” on, say, mapquest, you will have to figure out the weather predicted for a given route and display it in a user-friendly form. 2. Using the historical sale data from amazon.com, generate the sales trend for a given zip code vs weather (temperature). Plot the trend as output. 3. You can also interpolate the weather forecast from the data collected for the previous week and some reasonable weather prediction model. This should also consume an external web service. Each group should choose a unique problem for this part. The choice has to