products

Document Sample
products Powered By Docstoc
					Grid Activities at UVIC
        Graeme Smecher
        gsmecher@uvic.ca


      Simon Fraser University




                                Grid Activities at UVIC – p.1
What I’ll cover

      General overview of the Grid
   




                                     Grid Activities at UVIC – p.2
What I’ll cover

      General overview of the Grid
   




      UVIC’s Grid testbed
   




                                     Grid Activities at UVIC – p.2
What I’ll cover

      General overview of the Grid
   




      UVIC’s Grid testbed
   




      The upshot
   




                                     Grid Activities at UVIC – p.2
What is the Grid?

The Grid is...
      a framework for parallel computing
   




                                           Grid Activities at UVIC – p.3
What is the Grid?

The Grid is...
      a framework for parallel computing
   




      clustering on an Internet scale
   




                                           Grid Activities at UVIC – p.3
What is the Grid?

The Grid is...
      a framework for parallel computing
   




      clustering on an Internet scale
   




      tapping the global pool of unused resources
   




                                             Grid Activities at UVIC – p.3
What is the Grid?

The Grid is...
      a framework for parallel computing
   




      clustering on an Internet scale
   




      tapping the global pool of unused resources
   




The “Power Grid” analogy




                                             Grid Activities at UVIC – p.3
What is the Grid?

The Grid is...
      a framework for parallel computing
   




      clustering on an Internet scale
   




      tapping the global pool of unused resources
   




The “Power Grid” analogy
      commoditizes cycles
   




                                             Grid Activities at UVIC – p.3
What is the Grid?

The Grid is...
      a framework for parallel computing
   




      clustering on an Internet scale
   




      tapping the global pool of unused resources
   




The “Power Grid” analogy
      commoditizes cycles
   




      requirements shift from peak to average
   




                                                Grid Activities at UVIC – p.3
What is the Grid?

The Grid is...
      a framework for parallel computing
   




      clustering on an Internet scale
   




      tapping the global pool of unused resources
   




The “Power Grid” analogy
      commoditizes cycles
   




      requirements shift from peak to average
   




      brings new problems within reach
   




                                                Grid Activities at UVIC – p.3
Grid efforts

What exists today?

      local clustering products, (Condor, PBS, LSF)
   




                                              Grid Activities at UVIC – p.4
Grid efforts

What exists today?

      local clustering products, (Condor, PBS, LSF)
   




      commercial Grid products (SUN, IBM)
   




                                              Grid Activities at UVIC – p.4
Grid efforts

What exists today?

      local clustering products, (Condor, PBS, LSF)
   




      commercial Grid products (SUN, IBM)
   




      academic efforts (notably, Globus)
   




                                              Grid Activities at UVIC – p.4
The Globus Project




                     Grid Activities at UVIC – p.5
The Globus Project

The Globus Project




                     Grid Activities at UVIC – p.5
The Globus Project

The Globus Project
      http://www.globus.org
   




                              Grid Activities at UVIC – p.5
The Globus Project

The Globus Project
      http://www.globus.org
   




      Government and Academic collaboration
   




                                          Grid Activities at UVIC – p.5
The Globus Project

The Globus Project
      http://www.globus.org
   




      Government and Academic collaboration
   




      a family of protocols and APIs
   




                                          Grid Activities at UVIC – p.5
The Globus Project

The Globus Project
      http://www.globus.org
   




      Government and Academic collaboration
   




      a family of protocols and APIs
   




      under active development
   




                                          Grid Activities at UVIC – p.5
The Globus vision

The Short Term: Infrastructure for existing
programs
      security infrastructure (GSI)
   




                                              Grid Activities at UVIC – p.6
The Globus vision

The Short Term: Infrastructure for existing
programs
      security infrastructure (GSI)
   




      “run my job” program (globus-job-run)
   




                                              Grid Activities at UVIC – p.6
The Globus vision

The Short Term: Infrastructure for existing
programs
      security infrastructure (GSI)
   




      “run my job” program (globus-job-run)
   




      information services (MDS)
   




                                              Grid Activities at UVIC – p.6
The Globus vision

The Short Term: Infrastructure for existing
programs
      security infrastructure (GSI)
   




      “run my job” program (globus-job-run)
   




      information services (MDS)
   




      file transfer services (GridFTP)
   




                                              Grid Activities at UVIC – p.6
The Globus vision

The Short Term: Infrastructure for existing
programs
      security infrastructure (GSI)
   




      “run my job” program (globus-job-run)
   




      information services (MDS)
   




      file transfer services (GridFTP)
   




      organizational infrastructure
   




                                              Grid Activities at UVIC – p.6
The Globus vision (cont’d)

The Medium Term: Tools for developers




                                        Grid Activities at UVIC – p.7
The Globus vision (cont’d)

The Medium Term: Tools for developers
      Globus “bag of technologies”
   




                                        Grid Activities at UVIC – p.7
The Globus vision (cont’d)

The Medium Term: Tools for developers
      Globus “bag of technologies”
   




      avoid re-inventing the wheel
   




                                        Grid Activities at UVIC – p.7
The Globus vision (cont’d)

The Medium Term: Tools for developers
      Globus “bag of technologies”
   




      avoid re-inventing the wheel
   




      Remember CORBA?
   




                                        Grid Activities at UVIC – p.7
The Globus vision (cont’d)

The Medium Term: Tools for developers
      Globus “bag of technologies”
   




      avoid re-inventing the wheel
   




      Remember CORBA?
   




The Long Term: Science Fiction




                                        Grid Activities at UVIC – p.7
The Globus vision (cont’d)

The Medium Term: Tools for developers
      Globus “bag of technologies”
   




      avoid re-inventing the wheel
   




      Remember CORBA?
   




The Long Term: Science Fiction
      Grid achieves world peace
   




                                        Grid Activities at UVIC – p.7
UVIC Grid Work




                 Grid Activities at UVIC – p.8
UVIC Grid Work

Some context:




                 Grid Activities at UVIC – p.8
UVIC Grid Work

Some context:
      the “Muse” cluster
   




                           Grid Activities at UVIC – p.8
UVIC Grid Work

Some context:
      the “Muse” cluster
   




         40-node Linux cluster
        




                                 Grid Activities at UVIC – p.8
UVIC Grid Work

Some context:
      the “Muse” cluster
   




         40-node Linux cluster
        




         old nodes available for our use
        




                                           Grid Activities at UVIC – p.8
UVIC Grid Work

Some context:
      the “Muse” cluster
   




         40-node Linux cluster
        




         old nodes available for our use
        




         using Condor scheduler
        




                                           Grid Activities at UVIC – p.8
UVIC Grid Work

Some context:
      the “Muse” cluster
   




         40-node Linux cluster
        




         old nodes available for our use
        




         using Condor scheduler
        




      Condor experiments on workstations
   




                                           Grid Activities at UVIC – p.8
UVIC Grid Work

Some context:
      the “Muse” cluster
   




         40-node Linux cluster
        




         old nodes available for our use
        




         using Condor scheduler
        




      Condor experiments on workstations
   




      Prototype terabyte file server
   




                                           Grid Activities at UVIC – p.8
UVIC Grid Work

Some context:
      the “Muse” cluster
   




         40-node Linux cluster
        




         old nodes available for our use
        




         using Condor scheduler
        




      Condor experiments on workstations
   




      Prototype terabyte file server
   




      computing resources used for BaBar
   




      production
                                           Grid Activities at UVIC – p.8
The UVIC Grid Testbed




                        Grid Activities at UVIC – p.9
The UVIC Grid Testbed

A Grid testbed should be:




                            Grid Activities at UVIC – p.9
The UVIC Grid Testbed

A Grid testbed should be:

      easy to administrate
   




                             Grid Activities at UVIC – p.9
The UVIC Grid Testbed

A Grid testbed should be:

      easy to administrate
   




      easy to scale
   




                             Grid Activities at UVIC – p.9
The UVIC Grid Testbed

A Grid testbed should be:

      easy to administrate
   




      easy to scale
   




      secure
   




                             Grid Activities at UVIC – p.9
The UVIC Grid Testbed

A Grid testbed should be:

      easy to administrate
   




      easy to scale
   




      secure
   




      reliable
   




                             Grid Activities at UVIC – p.9
The UVIC Grid Testbed

A Grid testbed should be:

      easy to administrate
   




      easy to scale
   




      secure
   




      reliable
   




      usable
   




                             Grid Activities at UVIC – p.9
The UVIC Grid Testbed

A Grid testbed should be:

      easy to administrate
   




      easy to scale
   




      secure
   




      reliable
   




      usable
   




      cheap
   




                             Grid Activities at UVIC – p.9
Testbed Topology
               Internet   LAN
        (.phys.uvic.ca)   (.testbed.phys.uvic.ca)
                                                         NFS server
                                                         Kerberos KDC
                                                         Condor controller
                                        secure           LDAP server




                   grid   firewall

                                             Switch
      Internet
       uplink




 DHCP server
 DNS server
 Globus servers
 Firewall / NAT
 Web server
 Mail server
 Sendmail host
 IMAP server
 Condor console                grid01       grid03    grid05      Grid Activities at UVIC – p.10
Technologies Used




                    Grid Activities at UVIC – p.11
Technologies Used

Infrastructure:




                    Grid Activities at UVIC – p.11
Technologies Used

Infrastructure:
      LDAP and Kerberos
   




                          Grid Activities at UVIC – p.11
Technologies Used

Infrastructure:
      LDAP and Kerberos
   




      DHCP
   




                          Grid Activities at UVIC – p.11
Technologies Used

Infrastructure:
      LDAP and Kerberos
   




      DHCP
   




      DNS, NTP, e-mail
   




                          Grid Activities at UVIC – p.11
Technologies Used

Infrastructure:
      LDAP and Kerberos
   




      DHCP
   




      DNS, NTP, e-mail
   




      NFS
   




                          Grid Activities at UVIC – p.11
Technologies Used

Infrastructure:
      LDAP and Kerberos
   




      DHCP
   




      DNS, NTP, e-mail
   




      NFS
   




      RedHat customized Kickstart
   




                                    Grid Activities at UVIC – p.11
Technologies Used (cont’d)




                             Grid Activities at UVIC – p.12
Technologies Used (cont’d)

Grid Software:




                             Grid Activities at UVIC – p.12
Technologies Used (cont’d)

Grid Software:
      Globus
   




                             Grid Activities at UVIC – p.12
Technologies Used (cont’d)

Grid Software:
      Globus
   




      Condor
   




                             Grid Activities at UVIC – p.12
Technologies Used (cont’d)

Grid Software:
      Globus
   




      Condor
   




      Condor-G
   




                             Grid Activities at UVIC – p.12
Grid Applications

      BaBar experiments
   




                          Grid Activities at UVIC – p.13
Grid Applications

      BaBar experiments
   




        BaBar is not mobile!
        




                               Grid Activities at UVIC – p.13
Grid Applications

      BaBar experiments
   




        BaBar is not mobile!
        




        ...we made it mobile.
        




                                Grid Activities at UVIC – p.13
The Upshot




             Grid Activities at UVIC – p.14
The Upshot

Our installation:




                    Grid Activities at UVIC – p.14
The Upshot

Our installation:
      It’s there — but it needs users
   




                                        Grid Activities at UVIC – p.14
The Upshot

Our installation:
      It’s there — but it needs users
   




      See http://grid.phys.uvic.ca for
   




      information




                                         Grid Activities at UVIC – p.14
The Upshot

Our installation:
      It’s there — but it needs users
   




      See http://grid.phys.uvic.ca for
   




      information

Other installations:




                                         Grid Activities at UVIC – p.14
The Upshot

Our installation:
      It’s there — but it needs users
   




      See http://grid.phys.uvic.ca for
   




      information

Other installations:
      technology exists
   




                                         Grid Activities at UVIC – p.14
The Upshot

Our installation:
      It’s there — but it needs users
   




      See http://grid.phys.uvic.ca for
   




      information

Other installations:
      technology exists
   




      community exists
   




                                         Grid Activities at UVIC – p.14
The Upshot

Our installation:
      It’s there — but it needs users
   




      See http://grid.phys.uvic.ca for
   




      information

Other installations:
      technology exists
   




      community exists
   




      prototypes and experience exist
   




                                         Grid Activities at UVIC – p.14
What’s Next?




               Grid Activities at UVIC – p.15
What’s Next?

      The Grid Canada effort
   




                               Grid Activities at UVIC – p.15
What’s Next?

      The Grid Canada effort
   




      Globus development
   




                               Grid Activities at UVIC – p.15
What’s Next?

      The Grid Canada effort
   




      Globus development
   




      Real Users for the testbed
   




                                   Grid Activities at UVIC – p.15
What’s Next?

      The Grid Canada effort
   




      Globus development
   




      Real Users for the testbed
   




Contacts and Addresses
      http://www.globus.org
   




      http://www.cs.wisc.edu/condor
   




      http://www.gridcanada.ca
   




      http://grid.phys.uvic.ca
   




                                      Grid Activities at UVIC – p.15

				
DOCUMENT INFO
Shared By:
Categories:
Stats:
views:28
posted:2/14/2010
language:
pages:77
Description: grid computing system - products - applications