Slide 1 - Community Grids Lab - Indiana University

							  Integration of Hand-Held
  Devices into Collaboration
        Environments
                  IC’02 Las Vegas, NV
                      June 27 2002

Geoffrey Fox, Sung-Hoon Ko, Kangseok Kim, Sangmi
                 Lee, Sangyoon Oh

       Community Grids Laboratory, Indiana University
           Computer Science, Indiana University
         Computer Science, Florida State University
                    Contents
   Garnet Collaborative system
   Universal Accessibility in Garnet
   Integration Handheld devices into collaboration
    environment
   Shared Applications in Garnet for Universal
    Accessibility
   Experimental Result
   Conclusions and Future Works
           Collaborative Systems
 Collaborative Systems supports coordination
  and cooperation of two or more people who
  attempt to perform a task or solve a problem
  together.
 Collaborating directly, sharing resources.
 The collaboration features:
 Basic interactive tools - Text Chat, Instant Messenger,
  White Board
 Shared resources – Shared Display, Resource
  Exporting, Sharing I/O devices
 Real-time Multimedia tools- Audio-video Conferencing
            Garnet Collaborative System
   Purpose : Support distance Education, Training and if possible
    Computing as Grid(Web) Services
   Integrate Synchronous and Asynchronous collaboration
   Support universal access including PDA’s collaboration with
    desktops
   Uniform XML event (message) based architecture
       All data structures defined in XML Schema GXOS
       XML for all metadata (Users, documents, computers) and object
        changes -- from text chats to display changes etc.
       MyXoS manipulate GXOS objects
   We build on GMS/JMS (Java Message Service) as industry
    standard to implement publish/subscribe model
   Support collaborative features : basic interactive features
    (textchat, whiteboard, etc.), shared resources (shared display,
    shared export), AV conferences.
       GMS (Garnet Message Service) System
   All message publication labels and subscription profiles
    are defined in XML
                Subscribes to all events to get
       Database persistence

                                                 Subscriber
                                               Profile Objects
     Message Queue                            Specify Query to
    Labeled by (XML)                            Event Label
      Topic Object




      Publishers                            Subscribers
        Integration Handheld devices into
            collaboration environment
   Garnet provides universal access including PDA’s
    collaborating with desktops
   GMS is not able to support light-weight clients.
     Limited computing power – CPU, memory size, display
     Network Environment – unreliable, unstable wireless
      communication, various network protocols
     Developing Environment – various operating systems

   New universal collaboration and access architecture is
    required: GMSME (Garnet Message Service Micro
    Edition)
                    GMSME
   Supports heterogeneous clients by customizing
    message depending on the client specifications.
   User profile and mobile device profile (screen size,
    device type) is defined with XML object metadata
    specification (GXOS)
   Consists of PDA Adaptor, Hand Held Message
    Service (HHMS) protocol, and API for application
    processors.
            GMSME – PDA Adaptor
   PC       PDA Adaptor
     PDA Adaptor looks like a conventional client to GMS and
      adapts data to specified client/user specifications
     “Listens” to all the messages and events on the Garnet
      collaboration systems by subscribing to GMS.
   PDA Adaptor           PDA Client
     Parses the GMS XML message body and delivers it to the
      mobile clients over HHMS.
     HHMS is a specially designed optimized protocol for light-
      weight devices.
PDA Adaptor (Personal Server)
    GMSME – Application Transports
   Instant Messenger
     supports to access from PDA Jabber clients to Jabber
      server.
     Parsing XML messages between PDAs and Jabber Server.

     Managing Presence information based on XML presence
      protocol (XXMP).
   Text Chat
     extends Text Chat feature built in Garnet to Mobile clients.
     Translates GMS messages between PDAs and Garnet
      collaborative systems.
IM and Text Chat Transports
     GMSME – Application Processors
   Shared Display
       Sharing frame-buffer corresponding to either a windows or entire
        desktop replicated among the clients.
       customizable display resolution ( smaller resolution, different display
        types etc.)
       Data compression, incremental update.
   Shared Export
       Convert (rendering of) object to some standard form that is more
        flexible than bitmap of Shared Display.
       Replicated appropriate viewer for each client (PDF HTML SVG
        Browsers)
       Adapts W3C’s SVG (Scalable Vector Graphics) for exporting 2D
        graphics. - Inherits the benefits of Vector graphics, XML document
        based model, SVG universal accessibility features (stylesheets,
        alternatives).
The Architecture of Shared Export

                                A
    Power Point    Convert
      Slides       to SVG

                               Well Formed
                               SVG Document              Parser

                             GMS
                                                              Style
                                               GMS           sheets   HHMP
                             JMS/GMS Server



                                                       Rendering
                                   GMS
                                                        Engine

                                                        Personal
     Grid Shared                                        Server
     SVG Browser
                      Grid Shared        Grid Shared
                      SVG Browser        SVG Browser




The workflow of shared SVG Export in Garnet System
                      My_Professor
   Collaborative User Interface providing integrated GUI
    to Garnet users accessing from mobile devices.
   Implements HHMS client for wireless devices.
   Provides user information about device, user,
    application to PDA adaptor.
   Designed specially for various devices : network
    protocols, display types, etc.
   Delivers messages from PDA Adapter to each
    application modules;
       Display IM message converted to HHMS by PDA
        Adaptor.
Garnet : Shared Display
Garnet : SVG
                           Experimental Results
   GMSME : iPaq H3650, WinCE 3.0, Personal-Java1.1
           Wireless 11 Mbit/s IEEE 802.11b

                                               Total Latency
                       10000

                        1000
       milli-seconds




                         100
                                                                                        GMSME
                          10                                                            GMS

                           1

                         0.1
                                                6
                                        64




                                                                       K
                                                    1K




                                                                              6K
                                                                K
                                                         4K
                                   16
                               4
                           1




                                                                                   1M
                                             25




                                                              16

                                                                    64
                                                                           25
                                             Message Size (bytes)
    Conclusions and Future Works
    A collaborative environment Garnet designed a
    universal event model using the pub-sub paradigm.
   A integration of PDAs into synchronous collaboration.
   PDA Adaptor maps system events into a form suitable
    for the PDAs and uses an optimized protocol.
   Future Works
       supporting various Handheld device including PalmOS and
        Cellular Phone.
       Web Service for Universal Access Collaboration