Docstoc

cts-6-image-generation-may23-11.ppt - Indiana University

Document Sample
cts-6-image-generation-may23-11.ppt - Indiana University Powered By Docstoc
					     Image Generation and
   Management on FutureGrid
                             CTS Conference 2011
                                 Philadelphia
                                 May23 2011
                                   Geoffrey Fox
                                   gcf@indiana.edu
               http://www.infomall.org https://portal.futuregrid.org
            Director, Digital Science Center, Pervasive Technology Institute
Associate Dean for Research and Graduate Studies, School of Informatics and Computing
                            Indiana University Bloomington



                                     https://portal.futuregrid.org
                    Motivation
• The goal is to create and maintain platforms in
  custom FG VMs that can be retrieved,
  deployed, and provisioned on demand.
• Imagine the following scenario for FutureGrid:
      fg-image-generate –o ubuntu –v lucid -s openmpi-bin,openmpi-
       dev,gcc,fftw2,emacs – n ubuntu-mpi-dev
      fg-image-store –i ajyounge-338373292.manifest.xml –n ubuntu-
       mpi-dev
      fg-image-deploy –e india.futuregrid.org –i /tmp/ajyounge-
       338373292.manifest.xml
      fg-rain –provision -n 32 ubuntu-mpi-dev




                           http://futuregrid.org
                            http://futuregrid.org
             Image Management
• A unified Image
  Management system to
  create and maintain VM
  and bare-metal images.




                                 Client
                                                                                Clients

• Integrate images through
  a repository to instantiate                                               FG Rain Services




                                 Service
  services on demand with                           Image
                                                               Repository
                                                  Management                  HPC Service           EC2 Interface
  RAIN.




                                                                                                                          FG Security
                                                                Service
                                                    Service


• Essentially enables the                           Image       Image

                                 Infrastructure
                                                                                 Moab           Nimbus       Eucalytpus
                                                   Generator   Repository
  rapid development and                                        Base OS &
                                                                                                Resource     Resource
  deployment of Platform                            BCFG2       Package
                                                               Repository
                                                                                 xCAT
                                                                                               Component    Component

  services on FutureGrid
                                Hard-
                                ware




                                                                                                             3rd Party
  infrastructure.                                                    FG Hardware
                                                                                                             Hardware




                                http://futuregrid.org
              Image Generation
                                                                                                                 WWW

                                                                                                     check for         Retrieve and
• Users who want to create a                                                Admin      User
                                                                                                      updates            replicate
                                                                                                                           if not
  new FG image specify the                                               Command line tools   Repository
                                                                                                                       available in
                                                                                                                        Repository
  following:                                                                                         Base OS
                                        OS, version,
    o   OS type                          hardware,
                                             ...
                                                                   Target Deployment
                                                                       Selection                   Base Software

    o   OS version                                                                                 FG Software

    o   Architecture                                                       Generate Image
                                                                                                  Cloud Software

    o   Kernel                                                                                     User Software
                                                                             Base Image
    o   Software Packages                                                                         Other Software

• Image is generated, then




                                                                                                                                 Pre-Deployment Pahse
                                                  Fix Base Image
                                                                                                        check for
  deployed to specified target.                                             Update Image                 updates


• Deployed image gets                                                        Verify Image
                                                                                                       execute security
                                                                                                           checks

  continuously scanned,                                                      Deployable
                                                                             Base Image
  verified, and updated.                                                                              store in Repository


• Images are now available for                                             Deploy Image            Repository




                                                                                                                                 Deployment Phase
  use on the target deployed
                                               Fix Deployable




                                                                            Update Image                check for
  system.                                                                                                updates
                                                   Image




                                                                             Verify Image              execute security
                                                                                                           checks

                                                                              Deployed
                                                                               Image
                            http://futuregrid.org
          Deployment View
                                             FutureGrid



 Users                                          Web Portal




                                                                FG Resource
          Image Management
                                                 Image
                      Web                         Repo         Web
           CLI
                     Service                                  Service
                                                                Cloud Provider


           Image Generator                                   VM
                                                               VM
                                                                 VM
                                                                   VM
Base OS                                                              VM
                                                                       VM
                 BCFG2
                                                                         VM
                                                                           VM




                               http://futuregrid.org
                                http://futuregrid.org
                       Implementation
• Image Generator                             • Image Management
  o   Still in development, but alpha                 o   Currently operating an
      available now.                                      experimental BCFG2 server.
  o   Built in Python.                                o   Image Generator auto-creates
  o   Debootstrap for debian &                            new user groups for software
      ubuntu, YUM for RHEL5,                              stacks.
      CentOS, & Fedora.                               o   Supporting RedHat and Ubuntu
  o   Simple CLI now, but later                           repo mirrors.
      incorporate a web service to                    o   Scalability experiments of
      support the FG Portal.                              BCFG2 to be tested, but
  o   Deployment to Eucalyptus &                          previous work shows scalability
      Bare metal now, Nimbus and                          to thousands of VMs without
      others soon.                                        problems.




                                 http://futuregrid.org
                                  http://futuregrid.org
Image Repository




      http://futuregrid.org

				
DOCUMENT INFO
Shared By:
Categories:
Tags:
Stats:
views:2
posted:2/25/2012
language:
pages:7