The LHC Computing Grid by huanghengdong

VIEWS: 13 PAGES: 16

									   The Worldwide LHC
     Computing Grid


      Visit of Spanish
Royal Academy of Sciences


          Dr Ian Bird
      LCG Project Leader
        15th April 2009
                          The LHC Computing Grid – February 2008
                      The LHC Data Challenge

                      • Once the accelerator is
                        completed it will run for 10-15
                        years
                      • Experiments will produce about
                        15 Million Gigabytes of data
                        each year (about 20 million CDs!)
                      • LHC data analysis requires a
                        computing power equivalent to
                        ~100,000 of today's fastest PC
                        processors
                      • Requires many cooperating
                        computer centres, as CERN can
                        only provide ~20% of the
                        capacity
CERN IT Department
 CH-1211 Genève 23
        Switzerland
     www.cern.ch/it
                                       Ian Bird, CERN, IT Department
                      Solution: the Grid
                      • Use the Grid to unite computing resources
                        of particle physics institutions around the
                        world
                      The World Wide Web
                      provides seamless access to
                      information that is stored in
                      many millions of different
                      geographical locations

                      The Grid is an infrastructure
                      that provides seamless
                      access to computing power
                      and data storage capacity
                      distributed over the globe
CERN IT Department
 CH-1211 Genève 23
        Switzerland
     www.cern.ch/it
                                        Ian Bird, CERN, IT Department
                      How does the Grid work?
                      • It makes multiple computer
                        centres look like a single
                        system to the end-user

                      • Advanced software, called
                        middleware, automatically
                        finds the data the scientist
                        needs, and the computing
                        power to analyse it.

                      • Middleware balances the
                        load on different resources.
                        It also handles security,
                        accounting, monitoring and
                        much more.

CERN IT Department
 CH-1211 Genève 23
        Switzerland
     www.cern.ch/it
                                         Ian Bird, CERN, IT Department
View of the ATLAS detector (under construction)




    150 million sensors deliver data …



        … 40 million times per second



                       Ian Bird, CERN, IT Department
Tier 0 at CERN: Acquisition, First pass reconstruction,
Storage & Distribution




                                              1.25 GB/sec
                                                 (ions)
                       Ian.Bird@cern.ch                     6
                      LHC Computing Grid project (LCG)
                      • More than 140
                        computing centres
                      • 12 large centres for
                        primary data
                        management: CERN
                        (Tier-0) and eleven
                        Tier-1s
                      • 38 federations of
                        smaller Tier-2
                        centres                                   PIC
                          – 7 Tier 2 in Spain:
                            supporting ATLAS,
                            CMS, LHCb
                      • 35 countries involved


CERN IT Department                                                          Ian.Bird@cern.ch
 CH-1211 Genève 23
        Switzerland
     www.cern.ch/it
                                            Ian Bird, CERN, IT Department
                                       Data Transfer




•   Data distribution from CERN
    to Tier-1 sites
    – Target rates easily exceeded
      for extended periods
    – For all experiments and to all
      Tier 1 sites
    – Also between Tier 1/Tier 2
      sites
               Grid activity
               • Workload continues to increase
                   – At the scale needed for physics
               • Distribution of work across
                 Tier0/Tier1/Tier 2 really illustrates
                 the importance of the grid system
                   – Tier 2 contribution is around 50%;
                     >85% is external to CERN

                     Tier 0 + Tier 1 sites


Tier 2 sites
First events
Impact of the LHC Computing Grid in Europe
 • LCG has been the driving force for the European multi-
   science Grid EGEE (Enabling Grids for E-sciencE)
 • EGEE is now a global effort, and the largest Grid
   infrastructure worldwide
 • Co-funded by the European Commission (Cost: ~170 M€
   over 6 years, funded by EU ~100M€)
 • EGEE already used for >100 applications, including…




    Bio-informatics     Education, Training           Medical Imaging
                      Ian Bird, CERN, IT Department
                                                                                                             EGEE-III
                           Enabling Grids for E-sciencE




 Flagship Grid infrastructure project co-funded by the European Commission
                                                                         Grid
                                                                     operations &
 Main Objectives                                                      Networking
                                                                     support 51%
                                                                                                                            User
                                                                                                                         Community
                                                                                                                         support 19%
       – Expand/optimise existing EGEE
         infrastructure, include more
                                                                                                                     Training
         resources and user communities                                                                                 8%
                                                                                        Dissemination
       – Prepare migration from a project-                                                     &       Integration
                                                                                         International and testing
         based model to a sustainable                                                    Cooperation       9%
                                                                                              6%                      Middleware
         federated infrastructure based on                                                     Management
                                                                                                                       eng. 5%

         National Grid Initiatives                                                                2%
                                                                       Duration: 2 years
                                                                       Consortium: ~140 organisations across 33 countries
                                                                       EC co-funding: 32Million €

EGEE-III INFSO-RI-222667                                  The EGEE project - Bob Jones - EGEE'08 - 22 September 2008            12
                                                                                                           EGEE Achievements - Infrastructure
                                                                                     Enabling Grids for E-sciencE
EGEE Production Grid Infrastructure
 Steady growth over the lifetime of the project
 Improved reliability




                                                                   No. Cores
80000
70000
60000
50000
40000
        How can we reduce the effort required to operate this expanding infrastructure?
30000
20000
10000
    0
        Apr-04


                           Oct-04


                                                Apr-05


                                                                   Oct-05


                                                                                     Apr-06


                                                                                                        Oct-06


                                                                                                                             Apr-07


                                                                                                                                                    Oct-07


                                                                                                                                                                              Apr-08
                                      Jan-05




                                                                            Jan-06




                                                                                                                  Jan-07




                                                                                                                                                                 Jan-08
                 Jul-04




                                                          Jul-05




                                                                                              Jul-06




                                                                                                                                        Jul-07




                    300
                                                                                                                                                                                No. Sites
                    250
                    200
                    150
                    100
                          50
                          0
                                                         Oct-04




                                                                                               Oct-05




                                                                                                                                           Oct-06




                                                                                                                                                                                            Oct-07
                                               Jul-04


                                                                   Jan-05


                                                                                     Jul-05


                                                                                                         Jan-06


                                                                                                                               Jul-06


                                                                                                                                                        Jan-07


                                                                                                                                                                                   Jul-07


                                                                                                                                                                                                     Jan-08
                                    Apr-04




                                                                            Apr-05




                                                                                                                    Apr-06




                                                                                                                                                                     Apr-07




                                                                                                                                                                                                              Apr-08




EGEE-III INFSO-RI-222667                                                                                                                                             The EGEE project - Bob Jones - EGEE'08 - 22 September 2008   13
                                       EGEE Achievements - Applications
                           Enabling Grids for E-sciencE


    • >270 VOs from several
      scientific domains
          – Astronomy & Astrophysics
          – Civil Protection
          – Computational Chemistry
          – Comp. Fluid Dynamics
          – Computer Science/Tools
          – Condensed Matter Physics
          – Earthwe match the expectations of the growing user communities?
          How do Sciences
              Will we
          – Fusion have enough computing resources to satisfy their needs?
          – High Energy Physics
          – Life Sciences
    • Further applications
      under evaluation


Applications have moved from
testing to routine and daily usage
           ~80-95% efficiency
EGEE-III INFSO-RI-222667                                  The EGEE project - Bob Jones - EGEE'08 - 22 September 2008   14
                          Enabling Grids for E-sciencE




Archeology        EGEE-III Partners in Spain: CESGA, CSIC,
Astronomy
                  UNIZAR, UCM IFAE/PIC, CIEMAT, UPV,
Astrophysics
Civil Protection RED.ES
Comp. Chemistry
Earth Sciences
Finance
Fusion                                                       >250 sites
Geophysics                                                   48 countries
High Energy Physics                                          >50,000 CPUs
Life Sciences                                                >20 PetaBytes
Multimedia                                                   >10,000 users
Material Sciences                                            >150 VOs
…                                                            >150,000 jobs/day




EGEE-II INFSO-RI-031688
Sustainability
 • Need to prepare for permanent Grid infrastructure
 • Ensure a high quality of service for all user communities
 • Independent of short project funding cycles
 • Infrastructure managed in collaboration
   with National Grid Initiatives (NGIs)
 • European Grid Initiative (EGI)




                       Ian Bird, CERN, IT Department

								
To top