Slide 1 - CUAHSI HIS

Document Sample
Slide 1 - CUAHSI HIS Powered By Docstoc
					      Overview of CUAHSI HIS
            Version 1.1
               David R. Maidment
Director, Center for Research in Water Resources
           University of Texas at Austin

 CUAHSI Biennial Science and Engineering Colloqium
            Boulder, CO, July 16, 2008
       HIS Workshop Overview
• Morning: 10AM – 12 noon
  – Overview of CUAHSI HIS and how to use it
• Lunch 12 – 1PM
• Afternoon 1PM – 3PM
  – Building a water data service
• Break 3PM – 3:30PM
• Afternoon 3:30 – 4:30PM
  – Discussion of future plans
       HIS Team and Collaborators
• University of Texas at Austin – David Maidment, Tim Whiteaker,
  Ernest To, Bryan Enslein, Kate Marney
• San Diego Supercomputer Center – Ilya Zaslavsky, David Valentine,
  Tom Whitenack
• Utah State University – David Tarboton, Jeff Horsburgh, Kim
  Schreuders, Justin Berger
• Drexel University – Michael Piasecki, Yoori Choi
• University of South Carolina – Jon Goodall, Tony Castronova
• CUAHSI Program Office – Rick Hooper, David Kirschtel, Conrad Matiuk
• WATERS Network – Testbed Data Managers
• HIS Standing Committee
• USGS – Bob Hirsch, David Briar, Scott McFarlane
• NCDC – Rich Baldwin
           HIS Overview Report

• Summarizes the
  conceptual framework,
  methodology, and
  application tools for HIS
  version 1.1
• Shows how to develop
  and publish a CUAHSI
  Water Data Service
• Available at:

 http://his.cuahsi.org/documents/HISOverview.pdf
                   Water Data
Water quantity
 and quality      Soil water       Rainfall & Snow




                                   Modeling
                     Meteorology
 Remote sensing
                   HIS Desktop
• Analytical functions
  controlled interactively
  by a human operator to
  generate information
  products
   – Observations Data Model
     and Tools
   – Excel, ArcGIS, Matlab,
     Google Earth
   – Your model or analysis
   Services-Oriented Architecture for
              Water Data
• Links geographically     HIS Servers in the WATERS Network
  distributed information
  servers through internet
• Web Services
  Description Language
  (WSDL from W3C)
• We designed WaterML
                           HIS Central at San
  as a web services        Diego Supercomputer
  language for water data Center
• Functions for computer
  to computer interaction                      Web Services
   Get Data

                     HIS Central
           WaterML




                     National Water
Get Metadata           Metadata
                        Catalog
Synthesis and communication of the
nation’s water data http://his.cuahsi.org
Government Water Data                       Academic Water Data




                          National Water
                            Metadata
                             Catalog




   Hydroseek                 WaterML
 CUAHSI Point Observation Data Services

1. Data Loading
  – Put data into the CUAHSI Observations Data
    Model
2. Data Publishing
  – Provide web services access to the data
3. Data Indexing
  – Summarize the data in a centralized cataloging
    system
 CUAHSI Point Observation Data Services

1. Data Loading
  – Put data into the CUAHSI Observations Data
    Model
2. Data Publishing
  – Provide web services access to the data
3. Data Indexing
  – Summarize the data in a centralized cataloging
    system
Data Values – indexed by “What-where-when”
                        Time, T


              “When”    t
                                             A data value

                             vi (s,t)

                                        s    “Where”

                                            Space, S
             Vi
    “What”

         Variables, V
Data Values Table

                        Time, T


                        t


                            vi (s,t)

                                       s
                                           Space, S
          Vi


         Variables, V
                                             Observations Data Model
Horsburgh, J. S., D. G. Tarboton, D. R. Maidment and I. Zaslavsky, (2008), "A Relational Model for
Environmental and Water Resources Data," Water Resour. Res., 44: W05406, doi:10.1029/2007WR006392.
 CUAHSI Point Observation Data Services

1. Data Loading
  – Put data into the CUAHSI Observations Data
    Model
2. Data Publishing
  – Provide web services access to the data
3. Data Indexing
  – Summarize the data in a centralized cataloging
    system
        Point Observations Information Model
Utah State     Data Source
   Univ
         Little Bear River   Network

                                                                          GetSites
     Little Bear River at Mendon Rd     Sites                             GetSiteInfo

                        Dissolved Oxygen        Variables              GetVariableInfo

                                                                       GetValues
                   9.78 mg/L, 1 October 2007, 5PM           Values
                                                            {Value, Time, Metadata}
 •   A data source operates an observation network
 •   A network is a set of observation sites
 •   A site is a point location where one or more variables are measured
 •   A variable is a property describing the flow or quality of water
 •   A value is an observation of a variable at a particular time
 •   A metadata quantity provides additional information about the value
       WaterML and WaterOneFlow

           Locations           GetSiteInfo           Data
                                                        Penn State
                               GetVariableInfo
  Variable Codes               GetValues
                                                            Data
       Date Ranges                                Data
                                                  NWIS
                                                           Utah State
                                WaterML

                              WaterOneFlow       Data
                              Web Service        Repositories
  Client
                               TRANSFORM         EXTRACT
   LOAD



WaterML is an XML language for communicating water data
WaterOneFlow is a set of web services based on WaterML
               WaterOneFlow
• Set of query functions   • Returns data in WaterML
     Texas Water Data Services


Using CUAHSI technology for state and
local data sources (using state funding)
Publishing an ODM Water Data Service


                                             Texas
   Texas Parks and      Texas Water                        Ingest Data From Different
                                             Instream
   Wildlife Dept        Development Board                           Sources
                                             Flow
                                             Program




                                                         Transform Data into Uniform
                                                           Format with SSIS Scripts




                                   WaterML
                                                        Load Newly Formatted Data into
Observations         TPWD ODM
                                                         ODM Tables in MS SQL/Server
Data Model
                     TWDB ODM
(ODM)
                     TIFP ODM                           Wrap ODM with WaterML Web
                                                        Services for Online Publication
Publishing a Hybrid Water Data
Service                                                        TCOON Metadata are
                                                               Transferred from XML to the
                                                               ODM
                                        WaterML


  TCOON                   TCOON                 TCOON          Web Services can both
 METADATA                                      DataValues
                         Water Data                            Query the ODM for
   ODM                    Service                              Metadata and use a Web
                                                               Scraper for Data Values
                                    Get Values from:
   Metadata From:           TCOON Web Site in Corpus Christi
ODM Database in Austin
  GetSites
  GetSiteInfo
  GetVariableInfo


                                                               Calling the WSDL Returns
    http://his.crwr.utexas.edu/tcoonts/tcoon.asmx?WSDL         Metadata and Data Values
                                                               as if from the same Database
 CUAHSI Point Observation Data Services

1. Data Loading
  – Put data into the CUAHSI Observations Data
    Model
2. Data Publishing
  – Provide web services access to the data
3. Data Indexing
  – Summarize the data in a centralized cataloging
    system
Data Series – Metadata description
                             Time
                                      There are C measurements
        End Date Time, t2             of Variable Vi at Site Sj from
                                      time t1 to time t2



                                    Count, C
       Begin Date Time, t1
                                    Site, Sj   Space


        Variable, Vi

     Variables
          Series Catalog
Sj
                                    Time
     Vi
               End Date Time, t2




                                           Count, C
              Begin Date Time, t1
                                           Site, Sj   Space


               Variable, Vi


     t1     Variables
     t2

     C
CUAHSI National Water Metadata Catalog
  Indexes:
  • 50 observation networks
  • 1.75 million sites
  • 8.38 million time series
  • 342 million data values




       NWIS
       STORET
       TCEQ
Data Searching
•     Search multiple heterogeneous data sources simultaneously regardless of semantic
      or structural differences between them
                                                                      Searching each data
                                                                       source separately

                    NWIS
                                     request
                                     return
                                                  request
                                                  return
                           request
                           return



              NAWQA
                           request
                           return                                                   NAM-12
                                                            request
                                                            return



                                 request
                                 return
                                                             request
                                                             return

                                               request
                                               return


                                                                            NARR

    Michael Piasecki
    Drexel University
 Semantic Mediation                     Searching all data sources
                                               collectively
                     GetValues



                     GetValues
                                                        NWIS


                     GetValues



                     GetValues
           generic
           request   GetValues



                     GetValues
                                                        NAWQA

Michael Piasecki     GetValues
Drexel University                NARR
                     GetValues
                                              HODM
                                Hydroseek
Bora Beran, Drexel         http://www.hydroseek.org




        Supports search by location and type of data across multiple observation
                         networks including NWIS and Storet
                   HydroTagger
          Ontology: A hierarchy of concepts




Each Variable in your data is connected to a corresponding Concept
 Water Quality in Moreton Bay,
Brisbane, Australia (Jane Hunter)
Synthesis and communication of the
nation’s water data http://his.cuahsi.org
Government Water Data                       Academic Water Data




                          National Water
                            Metadata
                             Catalog




   Hydroseek                 WaterML
           Accomplishments
• Observations Data Model (ODM) is robust;
• WaterOneFlow web services provide reliable
  access to ODM data;
• WaterML is a common language for water
  observations data from academic and
  government sources
• National Water Metadata Catalog is the most
  comprehensive index of the nation’s water
  observations presently existing.
                 Limitations
• Focus on observations data measured as time
  series at fixed point locations;
  – Needs adaptation for moving sensors, transects,
    one-time data collections and field surveys;
• Need to work more on
  – Coverages for weather, climate and remote
    sensing
  – Linking data and models      Observations   Models
  – Linking geographic features          WaterML
                                 Geography    Coverages

				
DOCUMENT INFO
Shared By:
Categories:
Tags:
Stats:
views:12
posted:8/30/2011
language:English
pages:34