Docstoc

Recent advances in the ChinaGrid Project

Document Sample
Recent advances in the ChinaGrid Project Powered By Docstoc
					Recent Advances in
 ChinaGrid Project
Hai Jin
Huazhong University of Science and Technology
Wuhan, China
hjin@hust.edu.cn
Huazhong University of Science
and Technology, located in the
central of China, was founded in
1953, and ranks the TOP 5
universities in China.



                                   2
                                   2
   Nation-wide Grid Projects in China
• China National Grid – CNGrid (Ministry of
 Science and Technology )
• China Education and Research Grid                         –
 ChinaGrid (Ministry of Education)
• China Science Grid Project (National Science
 Foundation)
  Two group efforts working on the grid middleware
   platform
      Group 1: ICT/CAS, HUST, Peking U., Tsinghua U., Xi’an Jiaotong U.,
       and Shanghai Supercomputer Center (CSGrid project)
      Group 2: Beihang U., Peking U., Tsinghua U., NIC/ CAS, NUDT
       (China Research and Development Environment Over Wide-area
       Network, CROWN)                                                      3
                                                                            3
           ChinaGrid in a Nutshell
• China Education and Research Grid
• Funded by Ministry of Education
• As the pilot grid application supported by National
  863 Hi-Tech R&D program
• Based on CERNET (China Education and Research
  Network)
• First Phase
    From 2003-2005
    12 key universities as initiative
    More than 6Tflops w/60TB
    20 key universities now

                                                        4
                                                        4
               About CERNET
• Second largest IP backboned network in China
   36 PoPs cover all the province capitals
   The network backbone is 2.5-10Gbps DWDM

• Cover more than 1,500 universities/colleges
 in about 200 cities
   About 20 million users
   Many universities have their own campus network in
    China



                                                         5
                                                         5
State-of-the-art of CERNET-1
                    To England   To Germany




                                                         ShenYang              To Canada
                                                   BeiJing
                                                                               To America

                                                                                 To Japan



                                          Xi An        NanJin
                            ChengDu                                 ShangHai
                                              WuHan




 External Export                                  GuangZhou

 Trunk Network
                                                                                            6
 Regional Network
                                                                                            6
ChinaGrid (The First Phase)




                              7
                              7
ChinaGrid (till now)




                       8
                       8
              ChinaGrid Mission
• Campus grid platform
• Common platform for ChinaGrid
• Grid application platform and
 representative grid applications
  Image processing grid
  Bioinformatics grid
  Course on-line grid
  Computational fluid dynamic grid
  Large scale information processing grid

                                             9
                                             9
         Campus Grids and their
     Computing Power and Storage
•   HUST:0.8Tflops, 5TB
                       Capacity
                          • ZSU:1.3Tflops, 10TB
• THU:1.3Tflops, 20TB     • SDU:1.3Tflops, 18TB
• PKU:1.5Tflops, 10TB     • NWPU:0.4Tflops, 2TB
• BUAA:0.7Tflops, 10TB    • ZJU:0.6Tflops, 3TB
• SCUT:0.9Tflops, 20TB    • FUDAN:1.8Tflops, 6TB
• SJTU:0.5Tflops, 9TB     • TONGJI:0.2Tflops, 1TB
• SEU:1.0Tflops, 19TB     • USTC:1.2Tflops, 5TB
• XJTU:0.1Tflops, 2.5TB   • UESTC:0.3Tflops, 2TB
• NUDT:0.2Tflops, 5TB     • RUC:0.1Tflops, 0.5TB
• NEU:0.8Tflops, 5TB      • LZU:0.3Tflops, 1TB
                                                     10
         ChinaGrid:>15Tflops, >150TB                10
      Layered Infrastructure of ChinaGrid
                                          SJTU
                                  PKU             XJTU
                         ZSU                               NEU
                                                                     SCUT
              HUST
                                                                            BUAA
       NUDT
                                    Remote                                          SEU
                          Image                      Fluid
                                   education
THU                                                dynamics                               SDU
                        processing   grid
                           grid                       grid             Massive
                                                                      information
       Bioinformatics
                                                                      processing grid
            grid
                   ChinaGrid Supporting Platform (CGSP)

                            High performance computing environment
                                        (campus grid)


                                                                                                11
                                                                                            11
              What’s CGSP?
• ChinaGrid Supporting Platform, a grid middleware
  for ChinaGrid
• Follow the WS-Resource Framework (WSRF) and
  Open Grid Service Architecture (OGSA)
• Beta version was announced last October at
  GCC’04 in Wuhan
• CGSP 1.0 was released Jan. 10, 2005
• Developed by the joint working group from HUST,
  THU, PKU, BUAA and SJTU
                                                      12
                                                     12
           Status of CGSP 1.0
• CGSP download more than 300 times
• Support three major grid applications of ChinaGrid
• Installed in 12 universities as campus grid
  environment




                                                        13
                                                       13
 14
14
                  ChinaGrid Supporting Platform
                                             Portal: Grid entry for submitting &
                                             monitoring job, querying resources’ info, user
                          Portal             management and accounting etc.

                                             Grid Developing Environment: a set of
                      Grid Developing        toolkits including portal development tools,
Security Module




                       Environment           resource encapsulation tools, programming
                                             tools and job generation tools etc.

                        Information Center   Information Center: the manager of resource
                                             & service information
                  Uniform Management         Uniform Management: a set of managers
                                             including job manager, data center, domain
                                             manager and service container
                     Computing Nodes
                                             Security: Identity authentication and
                                             mapping, service and resource
                                             authorization, secure transferring etc.
                                                                                            15
                                                                                        15
                   GT3.9 and CGSP
 Proxy         Data Center    Job Manager        Resource-Index         JAVA
(CGSP)           (CGSP)           Pre-WS
                                (CGSP)              (CGSP)
    GSI         New GridFTP                           MDS2             WS Core
                                   GRAM
                                                                       (WSRF)
              MetaData-Man     WorkFlow           HyperService
                 (CGSP)         (CGSP)               WS-Index         C WS Core
WS-Security         RFT          WS-GRAM            (CGSP)
                                                                       (WSRF)

                                    CSF           InterDomain       Python Bindings
   CAS             RLS                               (CGSP)
                                (contribution)                       (contributed)

                               Portal SDK          Topologic        RemoteDeploy
 SimpleCA        OGSI-DAI       (CGSP)              (CGSP)             (CGSP)

                              Programming                            HotDeploy
  Authz                          Toolkits             pyGlobus
                    XIO                                               (CGSP)
Framework                        (CGSP)             (contributed)


                   Data          Resource           Information          WS
  Security
                Management      Management            Services           Core
                                                                                       16
                                                                                      16
                                        CGSP in Detail
                                                                 Portal
        Portal               Resource            Programming tools     Job generation            Management             Installation
   development tools     encapsulation tools     (GridRPC/GridPPI)          tools                   tools                  tools
                                                Grid Developing Environment
   Service               Resource              Fault-tolerance       Domain info                       User               Identity
 management             management              mechanism            management                     management            mapping

   Service               Topology             Quality of service      Metadata                        Status            Negotiation
   matching             management              management           description                      monitor             policy

                               Information Center                                                        Domain Manager
Job submission      Job monitoring          Job remote-deploy
                                                                                                                Certification authority
                                                                          Uniform access entry
Work flow management       Job scheduling      Service support
                                                                                                                 Identity certification
                    Job Manager                                            Metadata manager
                                                                                                                  Proxy management
    Remote&hot deploy                  Service monitor                 Storage resource manager
   Node resource monitor               Batch job service                                                            Single sign-on

                                                                            Replica catalog                   Security management of
     Life cycle        Service group          Notification                                                     service and container
     Base fault    GT3.9.1 core        Resource property                     Storage agent
                                                                                                                Resource access control

                  Service Container                                       Data Manager                               Security              17
                                                                                                                                          17
                     Working Flow of CGSP
                                                                    CA
     Global
     Local
                                                     J1        J2
                 Web App                2                                5 Request for S2        Container   S1           CMD
                                 Request for J1   Job manager
           1       Portal                            Container                  7                            S2          Legacy
                                                                                                                        Program
                                                           3                                     Container
                                                       Available    4
                                                                                                             S3          Remote
                                                        services    S2                                                  resources
                               Job information

                            Domain       Resource                                        6
                            manager    information        Information                Retrieve                S4
                                                             Center                 input data
                                                                                                 Container


                            Retrieve data

                                                                    Data Management                      Storage


Tool set      Management                                                                            Programming    Installation
                               Resource wrapping      Job Definition tools      Portal tools
                 GUI                                                                                   models         tools
                                     tools

           Administrators             Resource                         Developers                  programmers
                                      providers                           and
                                                                                                                                     18
                                                                                                                                    18
                                                                    Grid Constructors
 19
19
AG4ChinaGrid:GridAsia 2005




                              20
                             20
http://www.chinagrid.edu.cn




                               21
                              21
Bioinformatics Grid




                       22
                      22
          BioGrid Applications
• Protein target selection for rice genome
• Multi-sequence alignment for ganoderma
 family
• Gene joint for white mice
• Cardiovascular disease research


                                              23
                                             23
Image Processing Grid




                         24
                        24
       ImageGrid Applications
• Three-dimension reconstruction of digital
  virtual human being (HUST)
• Medical image diagnosis (ZSU)
• Remote sensing image processing(NUDT)




                                               25
                                              25
CFD Grid




            26
           26
   Pilot Applications based on CFD
                  Grid
• Shanhai JiaoTong University: Aircraft genetic
  optimization design system
• Xi’an JiaoTong University: Parallel algorithm for
  molecular dynamics
• Southern China University of Technology: Simulation
  and optimization techniques for metal powder
  figuration process
• Northeast University: Large scale geological disaster
  forecasting system
• Southeast University: Computational
  electromagnetism applications in airplane and
  automobile design
                                                           27
                                                          27
Course On-line Grid




                       28
                      28
         Course Resource
           Contribution
500 474
450
400
350                    332     332
300            283
                   251
250                                       213
                           202     205
200
150     117
                                                113
100
 50         32                         12
                                              0
  0
    PK TS XJ SJ DB SD HN HZ DN HK DZ BH ZS
• Number of courses: 233;Number of hours: 2566         29
                                                      29
                       Usage Survey
      User IP distribution(2004/08/27-2005/01/16)

    Server   Independent Total number of   Server   Independent Total number of
             IP number   HTTP GET                   IP number   HTTP GET
    PK1      15359          5868376        SD       1110         128816
    PK2      264            10970          UST      9513         1093657
    BY       2922           640255         XJ       3981         697464
    BH       121            10383          SJ       528          265055
    TS       818            125083         XB       1318         160240
    DB       1358 At least848936           LD       5101         618136
                           so
    DN       696 many people
                          71957            HZ       598          64299
    ZS       9370 use course-
                         1260541           HN       387 Total number
                                                                705687
                     online grid                           of access


Numbers of independent IPs:25,807;Total number of HTTP GET:12,569,855
                                                                                   30
                                                                                  30
Massive Information Processing Grid




                                       31
                                      31
University Digital Museum Grid
(UDMGrid)




                                  32
                                 32
Total Investment of China to Implement
     Initial Informalization by 2020
 • Computer                    3.900Trillion RMB
 • Internet Host and Systems   117.000Trillion RMB
 • Communication               6.100Trillion RMB
 • Digital TV                  1.950Trillion RMB
 • Total                       128.950Trillion RMB


 • It is necessary to lower down the cost of
  informalization greatly by using resource
  sharing and cooperative working                    33
                                                   33
Thanks!
           34
          34

				
DOCUMENT INFO
Shared By:
Categories:
Tags:
Stats:
views:0
posted:4/24/2013
language:English
pages:34
wang nianwu wang nianwu
About Those docs come from internet,if you have the copyrights of one of them,tell me by mail 8G7CNQQf@126.com,I just want more peo learn more knowledge.Thank you!