Get documents about "Developing a CUAHSI HIS Data Node, as part of
Document Sample
Developing a CUAHSI HIS Data Node,
as part of Cyberinfrastructure for the
Hydrologic Sciences
David Valentine
Ilya Zaslavsky
David R. Maidment
SAN DIEGO SUPERCOMPUTER CENTER
Overview
• Introduction
• Technology
• Present
• Screenshots
• Near Term
• Future
SAN DIEGO SUPERCOMPUTER CENTER
Hydrologic Science
It is as important to represent hydrologic environments precisely with
data as it is to represent hydrologic processes with equations
Physical laws and principles
(Mass, momentum, energy, chemistry)
Hydrologic Process Science
(Equations, simulation models, prediction)
Hydrologic conditions
(Fluxes, flows, concentrations)
Hydrologic Information Science
(Observations, data models, visualization
Hydrologic environment
(Dynamic earth)
SAN DIEGO SUPERCOMPUTER CENTER
Consortium of Universities for the
Advancement of Hydrologic Science, Inc
(CUAHSI)
CUAHSI HydroView Components
• Supported by the National
Science Foundation Hydrologic
• Develops Synthesis
cyberinfrastructure and
services for hydrologic
science in US universities
• Legally independent
Hydrologic
organization based in Observatories
Washington DC
• SDSC is the
Hydrologic
cyberinfrastructure partner Measurement
Information
Technology
Systems
SAN DIEGO SUPERCOMPUTER CENTER
Operating Systems and Software Use
SAN DIEGO SUPERCOMPUTER CENTER
Water OneFlow Web Services
• Like Geospatial OneStop,
we need a “Water
OneStop” – a common
window for water data
and models
• Advancement of water
science is critically
dependent on integration
of water information
SAN DIEGO SUPERCOMPUTER CENTER
Technology
• Commercial of the shelf (COTS) software
• Leverage ongoing cyberinfrastructure projects
• Geosciences Network (GEON)
• Share data between Earth Science disciplines
• Grid computing capabilities
• Web Services
SAN DIEGO SUPERCOMPUTER CENTER
Operating Systems
• ESRI ArcGIS
• Microsoft SQL Server • GEON Stack
• Custom Models • Java Portlets (Gridsphere)
• ArcHydro • Grid Authentication (GAMA)
• Hydrologic Observations • Distributed Storage (SRB)
Database
• Grid Processing Capabilities
• ASP.NET
• Workflow Capabilities
• Web services
• Web interfaces
• Provides
• data registration
• Provides
• searching
• a platform that scientists are
familiar with, and have • an archive
developed, and a presently using • Shared architecture for
to develop, software. Geosciences
SAN DIEGO SUPERCOMPUTER CENTER
Multi-platform Design
Central CUAHSI HIS Node (Windows) GEON Data Node (Linux)
HODM
HDAS Web Web
Services Service Geon Software Stack
IIS Web Server Proxy
ASP . Net Apache Tomcat
ArcGIS Web
Service
Technologies SQL Server
proxies
Data
Data
Remote CUAHSI HIS Node (Windows) Remote CUAHSI HIS Node (Windows) Remote CUAHSI HIS Node (Windows) Remote CUAHSI HIS Node (Windows)
Remote HDAS Web
Services
HODM
Web
Service
HDAS Web
Services
HODM
Web
Service
HDAS Web
Services
HODM
Web
Service
HDAS Web
Services
HODM
Web
Service
CUAHSI IIS Web Server
ASP . Net
IIS Web Server
ASP . Net
IIS Web Server
ASP . Net
IIS Web Server
ASP . Net
Web
HIS Nodes ArcGIS
Technologies SQL Server
Web
Service
proxies
ArcGIS
Technologies SQL Server
Web
Service
proxies
ArcGIS
Technologies SQL Server
Web
Service
proxies
ArcGIS
Technologies SQL Server Service
proxies
(Windows)
Data Data Data Data
Present (1/2)
• Water OneFlow Web Services
• NWIS, AmeriFlux, DAYMET, MODIS
• Databases
• Hydrologic Observations Data Model
• HDAS - Hydrologic Data Access System
• A map-based access system to hydrologic data
• We provide production access to data sources
via webservices, and access via a map-based
interface
SAN DIEGO SUPERCOMPUTER CENTER
Present (2/2)
• Problems
• Occasionally, Geon Services do not work in proxy
• CUAHSI ArcGIS server interfaces (eg HDAS) have
problems being wrapped in a portlet, and were not
designed to be wrapped.
• Producing a node distribution with COTS
SAN DIEGO SUPERCOMPUTER CENTER
SAN DIEGO SUPERCOMPUTER CENTER
SAN DIEGO SUPERCOMPUTER CENTER
SAN DIEGO SUPERCOMPUTER CENTER
SAN DIEGO SUPERCOMPUTER CENTER
SAN DIEGO SUPERCOMPUTER CENTER
SAN DIEGO SUPERCOMPUTER CENTER
Demo-Data Registration
SAN DIEGO SUPERCOMPUTER CENTER
Near Future
• Water OneFlow web services
• Standardize methods
• Refactor present services
• Provide codebase for community development
• Dataset specific methods
• ESRI ArcHydro server extension
• Point of presence distribution
• Documentation
SAN DIEGO SUPERCOMPUTER CENTER
Future
• Make it easier
• URL-Based access methods
http://ws.cuahsi.org/station/ameriflux/stationID/Variable/xml
• Data http://ws.cuahsi.org/station/ameriflux/stationID/Variable/excel
• Non-Map access methods
• Ontology search
• Site browse
• Attribute browse (by HUC, State, County)
• Others (tell us)
• Tools
• Documentation
SAN DIEGO SUPERCOMPUTER CENTER
Summary
• CUAHSI HIS is a community driven effort.
• COTS or open source best tool for the job.
• CUAHSI cyberinfrastructure will be a multi-
platform infrastructure that leverages the GEON
Infrastructure, and commercial software.
• Web services will allow for flexible development
• Community-developed implementations can replace
commercial implementations.
• MapWindows group is developing an OpenHydro data model to
provide an open source implementation of the ArcHydro
datamodel.
SAN DIEGO SUPERCOMPUTER CENTER
Questions
• Sites
• http://www.cuahsi.org/his/
• Listing of web services
• http://river.sdsc.edu/HDAS/
• Map interface to National Water Information System
• HIS Contacts
• valentin@sdsc.edu
• zavlask@sdsc.edu
SAN DIEGO SUPERCOMPUTER CENTER
SAN DIEGO SUPERCOMPUTER CENTER
SAN DIEGO SUPERCOMPUTER CENTER
Hydrologic Information System Service Oriented Architecture
Web portal Interface (HDAS)
Information input, display, query and output services
Preliminary data exploration and discovery. See
what is available and perform exploratory analyses
Uploads
Downloads
Web services
interface
3rd party HTML -XML
WSDL - SOAP
Data access
servers through web
services
WaterOneFlow
Web Services Data storage
through web GIS
services
e.g. USGS,
Matlab
NCDC
IDL
Observatory SDSC HIS Splus, R
servers servers D2K, I2K
Programming
(Fortran, C, VB)
SAN DIEGO SUPERCOMPUTER CENTER
Hydrologic Information System Service Oriented Architecture
Web portal Interface (HDAS)
Information input, display, query and output services
Preliminary data exploration and discovery. See
what is available and perform exploratory analyses
Uploads
Downloads
Web services
interface
3rd party HTML -XML
WSDL - SOAP
Data access
servers through web
services
WaterOneFlow
Web Services Data storage
through web GIS
services
e.g. USGS,
Matlab
NCDC
IDL
Observatory SDSC HIS Splus, R
servers servers D2K, I2K
Programming
(Fortran, C, VB)
SAN DIEGO SUPERCOMPUTER CENTER
Related docs
