Internet2 Network Update

Document Sample
Internet2 Network Update Powered By Docstoc
					Network Update

                    Steve Cotter
            Director, Network Services
               TNC2007, Copenhagen
                         May 22, 2007
Internet2 Network
Infrastructure Overview
• Layer 1: Managed wavelengths from Level(3) Communications
     • Level(3) owns and manages Infinera optical gear: responsible for software
       upgrades, equipment maintenance, remote hands, sparing, NOC services
     • Internet2 NOC has total provisioning control
• Layer 2: Internet2 owned and managed Ciena CoreDirectors
     • Using DRAGON GMPLS control plane
• Layer 3: Internet2 owned and managed Juniper T640s
• Expanded Observatory
     • Platform for layer 1/3 network performance data collection, collocation,
     • perfSONAR integration for intra- & inter-network performance analysis
• International connectivity
     • Layer 1 network extended to international exchange points in Seattle, Chicago
       and New York City
     • Peering points in Seattle, PAIX, Equinix Chicago

  Slide 2
                                                                                                                                                                                                       Optical Regeneration Node
                                                                                                                                                                                                       Full Optical Add/Drop Node
                                                                                                                                                                                                       Internet2 Connector
                                                                                                                                                                                                       Other Level 3 (Glass Through)

                                 1000 Denny                                                      Internet2 Network - Optical
  Pacific Northwest GP           Way
           2001 6th Ave          Level 3
            Westin Bldg

                                                                                                                                                                     Cleveland                                       Albany
          Portland                     Rieth                                                                                                                                                                                            Cambridge
        Oregon GP                                                                                                                                                    TFN                                             316 N Pearl
                             Portland                                                                                                                                4000 Chester                           Syracuse Level 3            NOX
 707 SW Washington           1335 NW Northrop                                                                                                       Chicago                                                                             300 Bent St
            Qwest                                                                                                                                                    Level 3                    Rochester
                             Level 3                                                                                                             CIC/MREN                                                                               Level 3

                                                                                                                                                                                                 Phase 1

                           Phase 4A
                                                      Boise                                                                                        BOREAS                                                                         Hartford
                                                                                                                                                   Internet2                                                     New York
                                                                                                                                            710 N Lakeshore                                                        111 8th        New York
            Tionesta                                                                                                                                                    Detroit                                    Level 3        NYSERNET

                                                                                                                                                                                                                                  32 Ave of the

    via 1075 Triangle Ct
                            May 18
                                Reno         Eureka

                                                                                                                                           600 W Chicago
                                                                                                                                              Level 3 MC                                   Pittsburgh

                                                                                                                                                                                                                            401 N Broad
                                                                                                                                                                                           Pittsburgh GP

                                                                   overlap                                                                                                                 143 S 25th                       Level 3

                                                                                                                                                 Phase 2
         Oakland           via 1005 N B St                                                                                                                                                 Level 3
                                                       Salt Lake                                                                                          1902 S East St                                              Washington
San Francisco                                                                    Denver                                                                                           Cincinnati                          MAX
                                              Inter-Mountain GP                                                                                           Level 3
                                                  572 S DeLong           Front Range GP                                                                                                                               1755 Old Meadow
                                                                              1850 Pearl                                                                                      Louisville                              Level 3

                                                                                                                                                 March 2
    Sunnyvale                                            Level 3                                                                       Kansas City St. Louis
       CENIC                                                                     Level 3                                               GPN                                    848 S 8th St
    1380 Kifer                                                                                                         Tulsa           1100 Walnut                            Level 3                              Raleigh

                                              Phase 4B
      Level 3          San Luis Obispo                                                                               OneNet            Level 3          Nashville                        Charlotte                 NCREN

                                                                                                                                       Phase 3A Complete
                                                                                                                 18 W Archer                      Tennessee GP                                                     5301 Departure Dr
                                                                                             Raton                   Level 3                                                                                       Level 3

                                                                                       Phase 3B
           Santa Barbara       Los Angeles                           Albuquerque                                                                   2990 Sidco Dr        Atlanta
                               818 W 7th                          New Mexico GP                                                                          Level 3

                                               June 12
                               Level 3                           104 Gold Ave SE

                                                                                                                                        April 19
                                                                                                                                                                        345 Courtland
          Los Angeles                                                     Level 3                                                                                                              Atlanta

                                                                                        April 27
               CENIC                                                                                                                                                                           180 Peachtree St NW
            600 W 7th        San Diego
                                                      Phoenix                          Rancho De La Fe                                                                                         Level 3 MC
               Equinix                                          Tucson


                                                                                                                         Dallas                                                                               FLR
                                                                          El Paso                                                                                 Mobile                                      4814 Phillips Hwy
                                                                   501 W Overland             Valentine                                                                                                       Level 3
                                                                          Level 3                                                                                                  Tallahassee
                                                                                                         Sanderson    Austin
                                                                                                                                                                New Orleans
                                                                                                                                                   Baton Rouge
                                                                                                                 San Antonio      Houston          LONI                                        Tampa
                                                                                                                                  LEARN            9987 Burbank
                                                                                                                                  1201 N I-45      Level 3
                                                                                                                                  Level 3                                                                    Miami
                                                                                                                                                                                                  South Florida GP
                                                                                                                                                                                                        45 NW 5th
                                                                                                                                                                                                            Level 3

              Slide 3
Page 4
Page 5
Page 6
Internet2 Network
Flexible Infrastructure Supporting e-Science, Network
Research & Education
• Dedicated point-to-point wavelength services
• Dynamic Circuit Service
    • Point-to-point Ethernet (VLAN) Framed SONET Circuit
    • Point-to-point SONET Circuit
    • Bandwidth provisioning available in 50 Mbps increments
• Best-effort high-speed IP Service
    • Enables delivery of advanced content, commodity services,
• Physical Connection
    • 1 or 10 Gigabit Ethernet
    • OC-192 SONET

 Slide 7
Internet2 Network
Dynamic Circuit Services
• Connection Oriented Services provide for:
   • Guaranteed bandwidth (predictable, repeatable, dependable
     performance between collaborating sites)
   • Traffic segregation (support specific policy or traffic engineering
   • Router bypass: Express links created for high-bandwidth, limited
     duration long-haul traffic reducing the need for mid-path L3 interfaces
           • Cost efficiency: L3 router blades cost > L2 ports > L1 or L0 interfaces
           • Capability tradeoff but could possibly improve performance
• Automated dynamic circuit services enable rapid provisioning
  and efficient utilization of capital investment
   • Establishing end-to-end lightpaths is a non-trivial task: it is resource
     intensive and error prone
   • Automated reservation, allocation, and provisioning enables co-
     scheduling of network and non-network resources.

 Slide 8
  •     Multi-Domain Provisioning                                                   GEANT

  •     Interdomain ENNI (Web Service and OIF/GMPLS)
  •     Multi-domain, multi-stage path computation process
  •     AAA
  •     Scheduling                                                                   TDM
                                                   Internet2 Network
          XML        Network

                     Dynamic Ethernet                                        Dynamic Ethernet

      Domain Controller                                                              ESNet
                                         Data Plane
      Ctrl Element                       Control Plane Adjacency
      SONET Switch                                                        IP Network (MPLS, L2VPN)

                                        Slide from Tom Lehman, ISI-East
        Slide 9
Internet2 Network
Dynamic Circuit Services Applications
• Create private networks between key collaborating
  sites within a science community or on a project-by-
  project basis. Examples:
     • Radio Astronomy community sharing telescopes and
       correlation facilities
     • High Energy Physics community distributing large data sets
     • Smaller projects may link data repositories and computational
       resources among key participants – e.g. grid portals
     • Network engineering and operations community can use
       these capabilities to support traffic engineering objectives
• We expect applications will use these circuit services
  to carry high-bandwidth, limited duration flows and will
  retain use of IP links for generic Internet access.

 Slide 10
Example: E-VLBI Application Specific Network
Globally Distributed, Unified Storage Clusters


            Mark 5
                                                             Correlator/Compute Cluster

                     VLSR    Global R&E Hybrid
            Mark 5                                   VLSR

                                                             Analysis station

                            Slide from Jerry Sobieski, MAX
 Slide 11
• The DICE group - Dante (GEANT2), Internet2,
  CANARIE, and ESnet
     • Working closely with ESnet on interfacing OSCARS and
       HOPI - involves AAA work, using OSCARS interface
     • “Stitching” project to describe data layer interconnections
       between segments of a PTP path
• Reporting back progress to the GLIF and other
     • For example, Phosphorus, in coordination with the SURFnet
       and University of Amsterdam participants
     • Also having discussions with JGN2
• Coordinating with OGF on various schema - topology,
  path computation, signaling
• Working with the appropriate standards bodies - ITU,
  IETF, and OIF

 Slide 12
For more information:

Thank you!

Slide 13
MAN LAN Exchange Point
32 Avenue of the Americas, NYC

• Layer 2: Cisco 6513
  Ethernet switch for IPv4/v6
  peering with 1GigE & 10
  GigE interfaces
• Layer 1: TDM based optical
  equipment (SONET /
  Ethernet interfaces)
     • Cisco 15454
     • Nortel OME 6500
     • Nortel HDX
• MAN LAN website:

 Slide 14
 Trans-Atlantic Connectivity
Connection to       Link Operator (Funder)       BW (Gbps)               N.A. Interconnect
CERN                LHCnet (CalTech) (DOE)       2x10, 1x10              MAN LAN, StarLight
CESnet (CZ)         CESnet (CESnet)              10                      StarLight
GEANT2 (Europe)     DANTE (GEANT2)               10, 10                  NGIX-East, MAN LAN
GEANT2 (Europe)     TransLight/StarLight (NSF)   10                      MAN LAN
GEANT2 (Europe)     Internet2/HOPI (Internet2)   10                      MAN LAN
SURFNET (NL)        SURFnet                      10, 10                  StarLight, MAN LAN
SURFNET (NL)        Internet2&SURFnet (IEEAF)    622Mbps                 Abilene-NYC
NetherLight         TransLight-StarLight (NSF)   10                      StarLight
NetherLight         Internet2&SURFnet (IEEAF)    10                      MAN LAN
RBnet (Russia)      Gloriad (NSF/Russia)         3x1 (on TL/SL link to   StarLight
ENERGI (Egypt)      ENERGI (MCIT)                155Mbps                 MAN LAN
UKLight (UK)        UKERNA (JISC)                10                      StarLight
Qatar Foundation    Qatar Foundation (Qatar      155Mbps                 MAN LAN
Network             Foundation)
TENET (S. Africa)   Telkom SA (TENET)            GRE tunnel              MAN LAN

   Slide 15
  Trans-Pacific Connectivity
Connection to          Link Operator (Funder)        BW (Gbps)     N.A. Interconnect
APAN TokyoXP           TransPAC2 (NSF/NICT)          10            Pacific Wave-LA
JGN2 (Japan)           NICT (NICT)                   10            StarLight
AARNET (Australia)     AARNET (AARNET)               2x10          Hawaii/Pacific Wave
CERNET (China)         CERNET (CERNET)               155Mbps       StarLight
CSTNET (China)         GLORIAD (CSTNET)              2.5           PacificWave-Seattle
KREONET (Korea)        GLORIAD (KREONET2)            10            PacificWave-Seattle
Hong Kong              HARNET                        45Mbps        StarLight
SINET (Japan)          NII (NII)                     10, 2.5       MAN LAN, PW-LA
GEMNET (NTT-Japan)     NTT (NTT)                     622Mbps       Pacific Wave
SingAREN (Singapore)   SingAREN (SingAREN)           155Mbps       Pacific Wave-LA
NUS (Singapore)        NUS (NUS)                     155Mbps       Pacific Wave - Seattle
TWAREN (Taiwan)        NCHC (NCHC)                   2, 2.5, 1.2   Pacific Wave, MAN LAN
ASNET (Taiwan)         ASNET (Academica Sinica)      2.5           StarLight
UNINET (Thailand)      UNINET (UNINET)               155Mbps       LA
WIDE                   WIDE&PNWGP (IEEAF)            10, 622Mbps   Pacific Wave - Seattle
Qatar FN               Qatar FN (Qatar Foundation)   155Mbps       Pacific Wave - LA

    Slide 16
   Americas Connectivity
Connection to                 Link Operator (Funder)    BW (Gbps)   US Interconnect
CA*net (Canada)               CANARIE (CANARIE)         ~50         StarLight/PWave/MAN LAN

redCLARA (Latin America),     WHREN-LILA (NSF,          1.2         AMPATH
ANSP (Brazil), RNP (Brazil)   FAPESP)
redCUDI (Mexico)              WHREN-LILA (NSF)          1           CALREN2

redCUDI (Mexico)              UTEP, CUDI (UTEP, CUDI)   1           UTEP

REACCIUN-2 (Venezuela)        AMPATH (AMPATH)           45Mbps      AMPATH

Gemini/NOAO, Chile            (NSF funding)             55Mbps      AMPATH

    Slide 17
 Provisioning Flow
                              Domain                  Domain                  Domain
                             Controller              Controller              Controller
                                                                                                  Need more
GUI          AST               AAA                     AAA                     AAA                work on AAA,
      XML                                                                                          Flexible Edge
                                                                  A                                   Mappings
                                                A                                                (port(s), tag, untag)
             1           4
                    2          NARB

                                                                          RON Dynamic Infrastructure
                                                                               Ethernet VLAN
         RON Dynamic Infrastructure
              Ethernet VLAN                        Internet2 DCS              A. Abstracted topology
1. Service Request                            Ethernet Mapped SONET               exchange
2. Path Computation Request
3. Recursive Per Domain Path Computation/Scheduling Processing
4. Path Computation/Scheduling Response (loose hop route object returned)
5. Service Instantiation (Signaling)

  Slide 18

Shared By: