Smart Media Network 1.0 week12 statusSlide 2Slide 3Slide 4Slide 5Server TeamLDAP SchemaDevicesDevice TeamDevices, cont’dJava Media Frame (JMF) In Pervasive and Mobile computingWindow Media Player / JMFSystem structure using JMFController designStreaming media between devicesSimple Media Networking Protocol (SMNP)SMNPSMNP (Continued)SMNP J2SE Screen ShotJ4ME Mixer Device ControllerJ4ME CD Device ControllerSlide 22Simulation Environments (using NS-2)Simulation Environments (cont’d)Slide 25Summary of EvaluationSmart Media Network 1.0 week12 statusController TeamServer TeamDevice TeamController / User Interfaces1. Discover / present media devices on the SMN network•LDAP2. Provide an interface to the device controls•Win32 / Borland C++ Builder3. Allow users to direct content from player to output devices•SOAP4. Present the changing state of the network•Devices entering or leaving•Device state changes (volume, track, etc…)TWO UNIQUE TRACKSUniversal Remote InterfaceHuman Centered InterfaceUniversal RemotePrimary intent is to provide a remedial interface to ALL controls published by devices on the SMN networkCurrently:•All devices (minus controllers) are presented•All controls are presented (although only Play, Stop and Volume have been published•When “Play” is selected, the user chooses an output device from a list of devices accepting the stream type•Device and control listings are refreshed every 10 secondsHuman Centered InterfacePrimary intent is to provide a hyper-usable interface to a select set of device and control types. Emphasis is on consistency of control between different devices. This controller will be usable in an eyes-free manner.2 Part Interface:•Physical (TurboRing Trackball)•Visual (on-screen display)Ring ALWAYS controls the volume•Quick swipes cclockwise mutes•Quick swipes clockwise restores volumeTrackball can…•Select a device•Move through tracks (CD, DVD…)•Change the station (TV, radio…)•Navigate media specific menus (DVD…)Button alternates the Play/Pause(Stop) state of devicesController DevelopmentTo date, most efforts have been toward developing the universal remote. This will guarantee a usable system.Techniques used in the universal remote will be applied to the Human Centered Remote. Both are developed for the same platform with same development environment and net libraries.While the Universal Remote is in a working state with only minimal technical obstacles remaining, the Human Centered Remote is still in its earliest stages (only a custom trackball/ring driver has been developed.Server Team•LDAP server based on OpenLDAP•Can run on very minimal PC (Pentium I, 166Mhz, 64MB, 2GB)•LDAP server modified to expire devices that do not re-register •Open problem: how to do LDAP server discovery?LDAP Schema•Devices and Controllers register themselves, re-register frequently•Devices publish their capabilities and controls•Capabilities include supported classes of functionality and stream types supported•Controllers publish the fact that they exist (for receiving event notifications)Devices•PLAYERS•Can generate a stream•Controlled by controllers using controls that the device publishes (some may have fixed semantics, some not)•PRESENTERS•Can accept a stream and render it in human-usable form (e.g. to a video monitor, to speakers) •Can be controlled by a controller or by a player deviceDevice Team•Audio: XMMS plugin (Icecast backend) to do Shoutcast streaming MP3•Video: VideoLan MPEG-2 streams with Perl scripts to control interaction with SMN to spawn/kill clients, change controls•Player/presenter architecture: when player receives a PLAY message it queries LDAP server then controls presenter with the controls it getsDevices, cont’d•Uses C++ for XMMS plug-in•Testing GUI written in Python•Videolan wrappers and device publishers written in Perl•OS used is Linux: Redhat 7.3 and 8.0Java Media Frame (JMF) In Pervasive and Mobile computingWindow Media Player / JMF•Window Media Player (WMP)•Stable, easy control•Longer initial time•Use Java.awt.Robot to simulate the control event •Difficult to update to new version / license issue•JMF•Construct a player by our own •Easy control•Short initial time•Platform independent•WMP and JMF can based on the same server and controllerSystem structure using JMF Commands Commands Commands Media list Media list Server Player Remote Player Controller System structure and implementationController design General ideas:• Select a poplar device as future controller• Simple usage• Ubiquitous access• Extremely reliable • Intuitive interaction • Easy to upgrade • Lower resource consumptionStreaming media between devices•JMF Supports Real-Time Transport Protocol– Capture and transmit real-time video– Present media files remotely•More available and more reliable by combining numerous devices, and using existing networking technology–Great future for pervasive and mobile computingSimple Media Networking Protocol (SMNP)COMP7970Pervasive and Mobile ComputingJames Pate Williams, Jr.SMNP•Proprietary solution to home entertainment wire snarl problem•Uses new line terminated strings over Transmission Control Protocol (TCP)•System consists of a central server, controllers, and devices, a device can have multiple controllers•A presentation device can be a controller/device hybridSMNP (Continued)•The system was implemented using Java 2 Standard Edition (J2SE) and Java 4 Mobile Edition (J4ME)•The system uses the Java Media Framework (JMF) and the Gracenote Compact Disc Database (CDDB) http://java.sun.com/products/java-media/jmf/ http://www.gracenote.com/developer/•The current system consists of an AVI movie/WAV file consumer/producer pair, a CD device, a master volume (mixer) device, J2SE controllers, and J4ME controllersSMNP J2SE Screen ShotJ4ME Mixer Device ControllerJ4ME CD Device ControllerVCD SVCD DVD DV-CResoultion 352x240 480x480 720x480 720x480(NTSC)Video MPEG1 MPEG2 MPEG1 or 2 DVCompression 1150Kbit/sec 2524Kbit/sec up to 9.8Mbit/sec 25Mbit/sec29.97 frames/sec 29.97 frames/sec 29.97 frames/sec 29.97 frames/secAudio MPEG1 MPEG1 MPEG1 DVCompression 224Kbit/sec 224Kbit/sec ? ?Total Bit Rate 1374Kbit/sec 2748Kbit/sec about 10Mbit/sec 36Mbit/secQuality Good Great Excellent Excellent(include track information and etc.)Type of StreamsSimulation Environments (using NS-2)123456...S