Docstoc

IT Architecture Overview

Document Sample
IT Architecture Overview Powered By Docstoc
					NWS Office of Science and Technology
   Systems Engineering Center
          (Skjei Telecom)

          Mike Asmussen
                                       1
Outline
• Introduction
• Requirements Development
   – Requirements approach
   – Key documents
   – Requirements summary
• Generalized IT architecture
   – Assumptions
   – Architecture efforts to date
   – Wx Products
   – FAA IT Architecture
   – NWS / NOAA IT Architecture Summary
– Next Steps


                                          2
3
Key Concepts
• NWS / NOAA architecture will follow a System of
 Systems approach
  • No one entity is building THE CUBE
  • It will be a federation of network-enabled services (some
    existing services, and some yet to be deployed)
  • Each service will be “registered” in a federated
    registry/repository, which
    •   Will provide descriptive information about each available
        service (via published metadata) and,
    •   Will point any interested service user to the appropriate
        service endpoint to allow service access
                                                                    4
5
Requirements Approach
•   Requirements Challenges
     •   Most available requirements are high level (not IT requirements)
     •   No single document serves as the “definitive” requirements source
     •   Some requirements not clearly characterized as:
         •   IOC/MOC/FOC
         •   Single Authoritative Source (SAS) / non-SAS

•   Approach
     •   Surveyed numerous JPDO and NOAA documents
     •   Determined relevant IT related requirements (as well as derived IT requirements)
     •   Categorized requirements
     •   Created table of requirements
         •   Where possible, assigned timeframe of deployment and whether requirement is SAS-specific

•   Identified Weak Areas
     •   Only limited IT performance and security requirements have been developed to date
     •   IOC Cube contents are still under consideration (required use cases still being examined)




                                                                                                        6
Key Documents
     Document Name                                        Version   Date        Source
     Concept of Operations for the Next Generation Air
     Transportation System                                  V2.0    6/13/2007   JPDO

     NextGen Network-Enabled Weather IT CONOPS              3.2     8/20/2008   NCAR, MITLL, NOAA/GSD

     NextGen ATS Enterprise Architecture                    V2.0    6/22/2007   JPDO

     Four-Dimensional Weather Functional                                        JPDO Functional Rqmts
     Requirements for NextGen Air Traffic Management        0.1     1/18/2008   Study Team
                                                                                JPDO Weather Integrated
     Weather Concept of Operations                          V1.0    5/13/2006   Product Team

     NextGen Weather Plan                                   0.6     3/20/2009   JPDO
     List of IOC and FOC products that NWS has
     committed to provide for NextGen

     Final Performance Requirements (iFR) First Working
     Draft Wrapper - 4-D Weather Data Cube SAS              Draft   2/11/2009   JDPO
     NextGen Weather Information Database -
     Information Technology Needs (Draft SON)               Draft   3/13/2009   OST
     Concept of Operations and Operational                                      Office of Climate, Water
     Requirements - WIDB for the NextGen 07-042                      5/4/2009   and Weather Services
                                                                                NEWP presentation by
     Definition of 4-D SAS                                          6/17/2009   JPDO Wx Policy Team2
                                                            Draft
     ATM Wx Integration Plan                                V0.7    4/22/2009   JPDO




                                                                                                           7
Requirements Summary
• Access                                  Availability
   – Aggregate overlapping requests
                                             Fault tolerance
   – High BW and low BW access
     methods support                         Load balancing
• Agility                                    Essential FAA service support - .999
   – Ability to add new systems,             Critical FAA service support - .99999
     services, products, data fields,
     users, etc. w/o system                  SAS (essential):
     interruptions                               MTTR - 0.5 hr,
   – Support legacy and new systems              MTBF – 5,000 hrs
     together                                    Outage max – 10 mins
   – Scalable over time                      SAS (critical):
• Archival / logging                             MTTR - 0.5 hr
   – Past transaction retrieval (e.g.,           MTBF – 50,000 hrs
     for accident investigations)                Outage max – 6 secs




                                                                                     8
Requirements Summary (cont)
•   Compatibility                                                   Data Consistency
     – With CWSUs, AWC, WFOs, Tower
       systems, TRACON systems, ARTCC,                                    Deconflicted SAS (temporal and spatial)
       ATCSCC                                                       Data Formats / Protocols
     – With FAA architecture
                                                                        Allowing ease of exchange
•   Contents                                                            Standards based (e.g. HTTP, XML, SOAP,
     –   Support Wx Products required for
         aviation purposes, for example:                                 OGC)
         •   NOAA provided, FAA-provided, 3rd party                 Discoverability (metadata/registry/
             provided
         •   North American and global                               repository)
         •   Forecasts model data (probabilistic)                       Products/data
         •   Sensor products
              –   Radar, lightning, satellite, aircraft sensors,        Formats
                  airport, ground, ocean, air, METARs
         •   Observations – PIREPS                                      Access methods
         •   Advisories, watches, warnings                              Associated services
         •   Climatological data
     –   Formats
         •   Grid based (machine readable) where possible
             (e.g., NETCDF4)
         •   Encoded versions of legacy text products (via
             WXXM or JMBL)
         •   Otherwise, text and graphic? Binary?



                                                                                                                     9
Requirements Summary (cont)
 Distributed (not centralized)                 Netcentric
 Ease of integration with aviation decision        SOA based
  support tools                                     System of systems
 Governance                                        Legacy system support (along with
    Access control                                 new systems)
    Standards                                  QOS / Performance
    Common ontologies                             Varies by user / use case / function
    Business rules                             Request management
    SAS decisions                                 Request / reply exchange mechanisms
 Intelligent processing                           Data for time period of choice
    Data interpolation                            Data for geographical construct of
                                                    choice
                                                   Product / data field of choice
                                                   Priority
                                                   Desired format / translations
                                                   Compression


                                                                                           10
Requirements Summary (cont)
•   Security
     – Data security
     – Physical / network security
     – Field by field, product by product
        access control
•   Subscription management support
•   SAS management and governance
•   System management
     – Failure detection / switchover
     – Load balancing
     – Health monitoring / analysis /
        trending / logging
•   Users
     – Aviation (primarily), governmental,
       commercial, military, international
     – Non-aviation, research, NOAA-
       internal
•   Verification / quality control


                                             11
12
Assumptions
 The following key assumptions are driving NOAA’s
 NextGen IT Architecture:
   Use of a System of Systems approach
   Compatibility with key NOAA and NWS Enterprise
      Architecture guidance
     Compliance with NextGen requirements (with flexibility
      to evolve as requirements evolve)
     Supports IT ConOps Use Cases
     Compatible with evolving FAA Architecture
     Supportive of NextGen Enterprise Architecture
      definition of Business Services / Operational Activities

                                                             13
Architecture Efforts to Date
•   Compiling requirements / use cases
•   Identifying required Wx Cube data (and candidate source / destination systems), flows, and formats
      •   Reconciling IOC Product list , FAA Product Flows spreadsheet, SA Plan, others
•   Working closely with FAA Architecture team to ensure architecture compatibility
       •  FAA architecture approach – Hub and spoke / Store and forward
           –   Federated registry / repository (for metadata)
           –   FAA Origin Servers (ingest/store/serve FAA data)
           –   FAA Distribution Servers (cache/handle requests of FAA users)
           –   FAA External Distribution Servers (handle requests to and from systems externally to FAA)
           –   Based on WCS/WFS Reference Implementation (RI) being developed by MITLL, NCAR, GSD which will be available
               for NOAA re-use
•   Reconcile JMBL vs. WXXM
      •   Working with GSD to evaluate use of JMBL – several JMBL RIs may be available for NOAA use
•   Standards decisions
       –  Non-gridded
           –   JMBL vs. WXXM (or both) for NOAA (FAA is standardizing on WXXM)
       –  Gridded data formats
           –   NetCDF4/HDF5, GRIB2? Others?
       –  Web Services / message exchange standards (e.g, WCS, WFS, JMBL, SOAP, XML, WMS? etc)
       –  Metadata standards
•   Beginning to work with NOAA/NWS weather system owners to ensure compatibility of IT architecture / migration approach
•   NWS IT System Architecture document and IT System Design document to be developed and released by March 2010 (with
    interim drafts prior)

                                                                                                                            14
Sample Wx Products List for
NextGen Inclusion
 NEXRAD Level III            •   MISs                         •   Mid level SIG Wx
 Lightning data              •   LAMP output                  •   Low level SIG Wx
 MADIS (TBD subsets)         •   Tropical cyclone bulletins   •   Winds aloft
 GOES data                   •   FAs                          •   RUC outputs
 METSAT data                 •   Tornado watch / warnings     •   WRF-RR outputs
 TAFs                        •   Severe thunderstorm          •   HRRR outputs
 METARs/SPECIs                   watch / warning              •   NCWF
 SIGMETS / G-SIGMETS         •   Convective outlook           •   NCWD
 AIRMETS / G-AIRMETS         •   Non-convective watches,      •   GTG
 Surface fronts
                                  warnings, advisories         •   FIP
 Meso-scale boundaries
                              •   Freezing level analysis      •   CIP
 3-D reflectivity products
                              •   Surface analysis             •   Global wind grids
 CCFPs
                              •   High level SIG Wx            •   ASOS OMOs
 CWAs
                              •   Verification statistics      •   Others?



                                                                                       15
Resultant Potential Candidate
Systems for Cube Inclusion                  •   NDFD
   ADDS
   AWIPS                                   •   NDGD
   CAWS                                    •   NESDIS
   GIS system                                        • GAS (GOES R)
   IOOS                                              • NDE (NPOESS)
   IRIS
                                                      • Non-NOAA systems
   Lightning Data Services
   MADIS                                   •   NEVS (RTVS, Stats on Demand)
   MDCRS                                   •   NEXRAD (Radar Data Server)
   NCDC                                    •   NSSL Mosaics
   NCEP/NOMADS                             •   RIDGE radar servers
          GFS (Global Forecast System)
                                            •   TOC (NWSTG/NOAANET)
          HRRR
                                            •   Web Farms
          LAMP
          NAM (North American Mesoscale)
                                            •   Other Sources for?
          RUC (Rapid Update Cycle)              • Canadian Radar
          WRF-RR                                • Puerto Rico model data
                                                 • STMAS data
                                                 • UKMET model data            16
17
Layered Architecture Approach




                                18
Internal FAA Architecture
Concept
                                                Consumer
                                                  Cube
                                                 Service                        End Users
                                                 Adaptor
                                                 (CCSA)
                                                              Consumer
  Provider                                                     Systems               Net-
  System                                                                           Enabled
                                                                                   Services
                          Registry/
                         Repository



     Origin Servers
          (with                                                  Distribution
      System Ingest                     IP                         Servers
         Adaptor                      Network
    and Provider Data)

                                                           4-D Wx Data Cube




                                                                                              19
Internal FAA Architecture
                                                                                     Weather Data Clients




                                                                                   Consumer Systems

                              ITWS                     ADAS
                                                                              Consumer Cube Service Adaptors

                                     Weather Data
                  ED-8               Origin Server
                 Gateway
                                                              Weather Data
                                                              Origin Server

                                                                                              Distribution
                           Router            Router
                                                                                                Server
        Distribution
        Servers for
      External Access


                                    FTI WAN / SWIM
                                                                                              Distribution
        Registry/                                                                               Server
        Repository



                                                     Router



                                             Distribution                            Consumer Cube Service Adaptors
        DMZ                 Router
                                               Server
                                                                                          Consumer Systems


        Weather Data
        Origin Server


                                              Consumer Cube Service Adaptors
                                                                                         Weather Data Clients
            NWP                                       Consumer Systems




                                                Weather Data Clients


                                                                                                                      20
21
22
23
Definitions
   Cube Input Edge Server (CIES)
        Allows remote access to the weather data (or subsets thereof) via WCS/WFS/other web services.
        Provides for the ingest of weather data required by the Cube (obtained either directly from the native source or via a
         Service Adaptor – which is mostly likely case for most data sources initially)
        Performs the necessary processing and local storage

   Cube Output Edge Server (COES)
      Provides for the request and retrieval of Cube data from remote WCS/WFS/other web services
      Performs the necessary processing and local storage
      Allows access to the data by the requesting local destination system.

   Service Adaptor (SA)
        Source Service Adaptor (SSA) - Performs processing to:
            Transform native or legacy source wx data that is required for publishing to the Wx Cube into a format appropriate
             for ease of access via Cube Input Edge Servers (e.g., transformed into one of several supported standards)
            To make source wx data available to Cube Input Edge Servers via a convenient and reliable network accessible means
             (e.g., Web Services-based communication) where such a means may not currently exist.
        Destination Service Adaptor (DSA) - Performs processing to:
            Transform wx data from a format appropriate for ease of access by Cube Output Edge Servers into a native or legacy
             format compatible with the destination system
        A Service Adaptor may be optional, where all such SA processing may instead be performed directly by a Cube Input Edge
         Server or Cube Output Edge Server or internal to the source or destination system themselves (for future systems).

   Optional Accessible Storage
        Optional storage to temporally hold wx data before being ingested into the cube or before being processed for use by the
         requesting destination system




                                                                                                                                    24
                                              CROSS ORGANIZATIONAL NOTIONAL ARCHITECTURE



                                                                 NOAA/NWS                             FAA                                                                        Weather Data Clients



MADIS
                 Cube Input
                 Edge Server
                                                                                                                                                                               Consumer Systems

                                                                                                                          ITWS                     ADAS
                                                                                                                                                                          Consumer Cube Service Adaptors


  AWIPS                                                                                                                          Weather Data
                 Cube Input                                                                                   ED-8               Origin Server
                 Edge Server                                                                                 Gateway
                                                                                                                                                          Weather Data
                                                                   NWSTG                                                                                  Origin Server

                                                                                                                                                                                          Distribution
                                                                                                                       Router            Router
                                                                                                                                                                                            Server
 NOMADS                                                                                           Distribution
                 Cube Input
                                                                                                  Servers for
                 Edge Server
                                                                                                External Access


                                                NWS IP                                                                          FTI WAN / SWIM
                                              NETWORKS                                                                                                                                    Distribution
                                              (NOAANET)                    Registry/                Registry/                                                                               Server
  NDFD                                                                     Repository               Repository
                 Cube Input
                 Edge Server

                                                                                                                                                 Router


                                                                                        Federated
Radar Data                                                                                                                               Distribution                            Consumer Cube Service Adaptors
                  Cube Input
                  Edge Server
                                                                                                    DMZ                 Router
                                                                                                                                           Server
                                                                                                                                                                                      Consumer Systems


                                                                                                    Weather Data
                                                                                                    Origin Server
Lightning Data
                                                                                                                                          Consumer Cube Service Adaptors
                 Cube Input                                                                                                                                                          Weather Data Clients
                 Edge Server    Cube Output
                                                   Cube Output     Cube Output
                                Edge Server
                                                   Edge Server     Edge Server                          NWP                                       Consumer Systems




Sat Data
                                                           MADIS                 NEVS
                 Cube Input              AWIPS
                 Edge Server
                                                    Wx Cube
     Wx Cube                                    Data Destinations                                                                           Weather Data Clients

      Data
     Sources

                                                                                                                                                                                                                  25
Example Architecture Use Cases
 Assumptions
    Reg/rep has already been queried in all cases
    Does not reflect any security aspects
 Use Case examples:
    Requestor-FAA, Data Source – NOAA, Data Type – NonGridded (WFS)
    Requestor-FAA, Data Source – NOAA, Data Type – Gridded (WCS)
    Requestor-NOAA, Data Source – FAA, Data Type – NonGridded (WFS)
    Requestor-NOAA, Data Source – FAA, Data Type – Gridded (WCS)
    Requestor-NOAA, Data Source – NOAA, Data Type – JMBL
    Requestor-FAA, Data Source – NOAA, Data Type – NonGridded (JMBL)
    Requestor-FAA, Data Source – NOAA, Data Type – Gridded (JMBL)




                                                                        26
27
28
29
30
31
32
                                         NOAA CUBE SOURCE ALTERNATIVE APPROACHES




                                                                                                         WX CUBE

 Intermediate                                                                 Optional        System        CIES           Net
                                                          Source Service
Stand-alone SA   Wx Data Source System
                                                          Adaptor (SSA)
                                                                           CIES-Accessible     Ingest    processing /    enabled
                                                                              Storage         Adaptor      storage         IF
   with CIES
                                                                                                            CIES




  Intermediate                                                                Optional        System        CIES           Net
                                         Source Service
   Bolt-on SA    Wx Data Source System
                                         Adaptor (SSA)
                                                                           CIES-Accessible     Ingest    processing /    enabled
                                                                              Storage         Adaptor      storage         IF
    with CIES
                                                                                                            CIES




     SOA via                                                                                  System        CIES           Net
     External    Wx Data Source System                                                         Ingest    processing /    enabled
                                                                                              Adaptor      storage         IF
      CIES
                                                                                                            CIES




    Fully SOA
     Solution                                                                                System        CIES           Net
                           Wx Data                                                            Ingest    processing /    enabled
   (embedded             Source System                                                       Adaptor      storage         IF
      CIES)                                                                                                CIES




                                                                                                                                   33
Example Architecture Use Cases
 Assumptions
    Reg/rep has already been updated in all cases
    Does not reflect any security aspects
 Use Case examples:
    Loading data into Cube: Source System to CIES via SSA
    Loading data into Cube: Source System to CIES using Optional Storage
    Loading data into Cube: Source System to CIES Directly




                                                                            34
35
36
37
                                              NOAA CUBE DESTINATION ALTERNATIVE APPROACHES


                                                                                                                                          WX CUBE
                                                                                                         Data Request

 Intermediate                                                                                        Optional            System        COES           Net
                                                                 Destination Service
Stand-alone SA   Wx Data Destination System
                                                                   Adaptor (DSA)
                                                                                                  COES-Accessible        Export     processing /    enabled
                                                                                                     Storage             Adaptor      storage         IF
  with COES
                                                                                                                                       COES




                                                                                                  Data Request

  Intermediate                                                                                       Optional            System        COES           Net
                                                Destination Service
   Bolt-on SA    Wx Data Destination System
                                                  Adaptor (DSA)
                                                                                                  COES-Accessible        Export     processing /    enabled
                                                                                                     Storage             Adaptor      storage         IF
   with COES
                                                                                                                                      COES



                                                                                       Data Request



     SOA via                                                                                                             System        COES           Net
     External    Wx Data Destination System                                                                              Export     processing /    enabled
                                                                                                                         Adaptor      storage         IF
      COES
                                                                                                                                       COES




    Fully SOA
     Solution                 Wx Data                                                                                   System        COES           Net
                             Destination                                                                                Export     processing /    enabled
   (embedded                  System                                                                                    Adaptor      storage         IF
     COES)                                                                                                                           COES




                                                                                                                                                              38
Example Architecture Use Cases
 Assumptions
    Reg/rep has already been queried in all cases
    Does not reflect any security aspects
 Use Case examples:
    NOAA Cube request via DSA (Intermediate Stand-alone or Bolt-on SA)
    NOAA Cube request with optional storage (Intermediate Stand-alone or Bolt-on SA)
    NOAA Cube request from Destination System (SOA via External COES)
    NOAA Cube request directly to Data Source (Embedded COES)




                                                                                        39
40
          Centralized Options

Wx Cube                   Wx Cube
 Data                      Data
Source                   Destination




Wx Cube                   Wx Cube
 Data         CIES         Data        COES
Source                   Destination




Wx Cube                   Wx Cube
 Data                      Data
Source                   Destination




                                              41
          Redundancy Options


             CIES                    COES




Wx Cube                 Wx Cube
 Data        CIES        Data        COES
Source                 Destination




             CIES                    COES




                                            42
43
44
Architecture Next Steps
• Identifying definitive source for each Cube WX product
• Defining Cube “format” for each Wx Product
• Resolving JMBL/WXXM standards decision (or decision to support both) and
  finalizing all exchange formats / protocols / standards
• Involving stewards of each Cube candidate system in determining details of
  “connecting” to the Cube
• Refining requirements / use cases (performance, security, verification, varied
  QOS offerings, external interfaces/system compatibilities, weather products
  needed)
• Determining key telecommunications infrastructure requirements, interfaces,
  and implementation details
• Finalizing high level NOAA Cube IT architecture (while ensuring compatibility
  with FAA architectural approach)
• Developing design for Cube edge servers

• And a million other things to do.


                                                                                   45

				
DOCUMENT INFO
Categories:
Tags:
Stats:
views:10
posted:1/11/2012
language:
pages:45