mds.ppt - cyberaide by dfhdhdhdhjr

VIEWS: 2 PAGES: 19

									Information Services

                             Andrew Brown
                                Jon Ludwig
                              Elvis Montero

                       Modified By Xi He




  Rochester Institute of Technology
Overview

• WSRF

• Monitoring and Discovery System in Globus


• Ganglia
WSRF
 Message Patterns for

 o   Define properties
 o   Request the value of a property or properties
 o   Alter the value of a property or properties

 So that we can

    Create state objects
    Get properties in state objects
    Set properties in state objects
    Destroy state objects
WSRF(CONT.)

 WSRF defines its message patterns by defining WSDL file

 WSRF Include identifier to specify resource

 example.wsdl
 example0.wsdl
 example1.wsdl

 A useful tutorial

 https://www6.software.ibm.com/developerworks/education/
   gr-wsrf1/index.html
MDS - Overview




                 [Globus01]
MDS – Aggregator and Information
Source Framework
Information sources for which discovery or access is
  required are explicitly registered with an aggregator
  service.

Registrations have a lifetime: if not renewed
 periodically, they expire.
MDS – Aggregator and Information
source (CONT.)
The aggregator periodically collects up-to-date state or
 status information from all registered information
 sources, by using an information-source-specific
 access mechanism.

The aggregator then makes all information obtained
 from registered information sources available via an
 aggregator-specific Web services interface.
MDS - Basic Components

• Index Service
  o   Collects information
  o   Stores as resource properties
  o   Supports queries and subscriptions
  o   Indices can be linked together
• Trigger Service
  o   Collects information
  o   Matches rules and fires actions
• WebMDS
  o   View information in web browser
  o   Used by end users
MDS – Example
The monitoring system for The Earth System Grid (ESG)

The Earth System Grid (ESG) provides climate studies scientists
with access to large datasets that are important for their work

The ESG infrastructure is a distributed system made up of
physical devices and software services

The ESG team needed a way to monitor the status of their
system components in order to detect and notify interested
parties of failures




                   http://www.globus.org/solutions/system_monitoring/
MDS – Example (CONT.)




         http://www.globus.org/solutions/system_monitoring/
Ganglia

• Real-time monitoring and execution environment for
  cluster
• Not only links nodes in a cluster, but also links clusters
  to other clusters
• Remotely view live or historical statistical data
• High performance
  o   Low overhead per node
  o   High concurrence
  o   Scalable
Ganglia Monitor Daemon - gmond

•   Multithreaded daemon
•   Runs on each node that you wish to monitor
•   Minimal footprint - In-memory hashtable
•   Responsibilities:
    o Monitor change in host state
    o Listens to the state of other Ganglia nodes
    o Multicast relevant changes
    o answer requests for an XML description of the
      cluster state
Ganglia Monitor Daemon - gmond




                           [GDT2002]
Ganglia Meta Daemon - gmetad
Ganglia Web Frontend

• Collects the tree of data from gmetad and
  displays it to the user via a website
• Demo
  o   http://monitor.millennium.berkeley.edu/
  o   http://cluster.rit.edu/ganglia/
• Periodically polls child data sources to gather
  information about cluster states
• Saves data in a database
• Collect data from individual nodes or from
  clusters
Ganglia Architecture
References
[Globus01] GT 4.0: Information
Services. http://www.globus.org/toolkit/docs/4.0/info/.

[OASIS] OASIS Web Services Resource Framework (WSRF)
TC. http://www.oasis-open.org/committees/tc_home.php?wg_abbrev=wsrf.

[Globus02] WSRF: The Web Services Resource
Framework. http://gdp.globus.org/gt4-tutorial/multiplehtml/ch01s03.html.

[Atkinson] Atkinson, Malcolm et al. Web Service Grids: An Evolutionary
Approach. http://www.omii.ac.uk/dissemination/paper_web_service_grids.pdf.

[Wikipedia01] Web Services Resource
Framework. http://en.wikipedia.org/wiki/Web_Services_Resource_Framework.
References cont.
[Foster] Foster, Ian. A Globus
Primer. http://www.globus.org/toolkit/docs/4.0/key/GT4_Primer_0.6.pdf.

[Globus03] Deploying WS MDS in a Virtual Organization.
http://www.globus.org/toolkit/docs/4.0/info/key/deployment_overview.html.

[Globus04] GT 4.0 WS MDS WebMDS: System Administrator’s Guide.
http://www.globus.org/toolkit/docs/4.0/info/webmds/admin-index.html.

[Globus05] GT 4.0 WS MDS Trigger Service: System Administrator’s Guide.
http://www.globus.org/toolkit/docs/4.0/info/trigger/admin-index.html.

[Wikipedia02] Ganglia (software).
http://en.wikipedia.org/wiki/Ganglia_%28software%29.
References cont.
[GDT2002] Ganglia
Toolkit. http://www.msg.ucsf.edu/local/ganglia/ganglia_docs/index.html

[Massie2004Ganglia] "The Ganglia Distributed Monitoring System: Design,
Implementation, and Experience". Matthew L. Massie, Brent N. Chun, and David
E. Culler. Parallel Computing, Vol. 30, Issue 7, July 2004.

[ESG] The Earth System Grid (ESG) monitoring architecture.
http://www.globus.org/solutions/system_monitoring/architecture.php.

[MonaLISA] MonaLISA's
Architecture. http://monalisa.cacr.caltech.edu/monalisa_e__System_Design.htm.

[Inca] Inca's architecture and screenshots. http://inca.sdsc.edu/drupal/node/20.

[IBM] WebMDS Screen Shot. http://www.ibm.com/developerworks/cn/grid/gr-
gt4mds/webMDSRFT.jpg

								
To top