I-COADS Data and Products

Document Sample
I-COADS Data and Products Powered By Docstoc
					I-COADS Data and Products
          for NODC
      Steven J. Worley
    Topics

    • Background
    • Status
    • Plans




NODC, December 3. 2003   I-COADS Data and Products   2
    Background

    • Three-way collaboration since 1981
    • Partner organizations and PI’s
           – NOAA/NCDC, (Dick Reynolds)
           – NOAA/CDC, (Scott Woodruff)
           – NSF/NCAR,  (Steven Worley)
    • Now, International-COADS (I-COADS)


NODC, December 3. 2003   I-COADS Data and Products   3
                              Current Status, Release 2.0
                              I-COADS Release 2.0, 2003
                              DM 1784-1997, RT 1998-2002

                          8


                          7


                          6
                                                                              RT Archive 1998-2002
Reports/Year (Millions)




                          5


                          4
                                                 185 Million Observation Records

                          3

                                                    DM Archive 1784-1997
                          2


                          1


                          0
                           1790        1810       1830     1850     1870       1890           1910   1930       1950   1970   1990
        NODC, December 3. 2003                                    I-COADS Data and Products                 4
                           Current Status, Release 2.0
                                 I-COADS Release 2.0, 2003
                                 DM 1784 -1950

                           1.2



                            1
 Reports/Year (Millions)




                           0.8



                           0.6



                           0.4                               100K per year,
                                                             1854-1885

                           0.2


                                                                              WWI and WWII
      0
       1790 3. 2003
NODC, December 1800 1810 1820 1830 1840 1850 1860 1870 1880 1890 51900 1910 1920 1930 1940
                                     I-COADS Data and Products
                              Current Status, Release 2.0
                              I-COADS Release 2.0, 2003
                              DM 1784-1997, RT 1998-2002
                                                                  NODC Data in I-COADS

                          8


                          7
                                                                                                               1980 – 1996
                          6                                                                                    WOD98
Reports/Year (Millions)




                          5                                                                   1950 - 1979
                                                                                              WOD94
                          4

                                                                     1870’s – 1949
                          3
                                                                     WOD98
                          2


                          1


                          0
                           1790        1810       1830     1850   1870        1890        1910      1930       1950   1970   1990
                   NODC, December 3. 2003                         I-COADS Data and Products                6
    NODC data in I-COADS
    • What data?
           – All surface met. and ocn. observations
           – Profile T as SST if QC=OK and Z  3m
           – ID feature: DCK, SID (94 vs 98), PT (btl, ctd, mbt,
             xbt)
    • Future
           – WOD01, plus updates
           – Surface data category – nice addition!
    “Syd is always looking out for other data sources for us “

      Do you know of any other data sources?
NODC, December 3. 2003       I-COADS Data and Products   7
    Data Availability
    • Observations
           – NCAR
                  • 1784 - 2002 binary formatted archive is online
                  • ASCII format available by online request
                     – Select region
                     – Select time
                     – Select variables
                     – Select quality flags and options
                     – Delayed mode delivery via pull FTP
                   Much like NODC WODselect
NODC, December 3. 2003          I-COADS Data and Products   8
    Data Availability, Observations @ NCAR
                              NCAR, Unique Users, Past 12 Months




         70

         60
                                      43
         50
                                                                           All Other Nations
         40
                                                                           U.S.
         30

         20                           27

         10

          0
                                  1

                         I-COADS Observations


    http://dss.ucar.edu/pub/coads/forms/
NODC, December 3. 2003                     I-COADS Data and Products   9
    Data Availability
    • Observations
           – CDC
                  • Derived from NCEP GTS
                  • 1991-current, online, ASCII
                  • Updated monthly
                  • Primary Usage
                         – Extend I-COADS to near real-time




    http://www.cdc.noaa.gov/coads/nrt.html
NODC, December 3. 2003               I-COADS Data and Products   10
    Data Availability

    • Monthly Statistics
           – 1°x1°, 1960 - 1997
           – 2°x2°, 1800 – 2002

           – NCAR
                  • Access equivalent to observations
                         – Full binary format archive is online
                         – ASCII format with subset selection capability



NODC, December 3. 2003                I-COADS Data and Products   11
    Data Availability, MSG @ NCAR
                          NCAR, Unique Users, Past 12 Months




      120


      100


       80                        79                                    All Other Nations
                                                                       U.S.
       60


       40

                                 26
       20


        0
                         I-COADS MSG


    http://dss.ucar.edu/pub/coads/forms/
NODC, December 3. 2003                I-COADS Data and Products   12
    Data Availability
   • Monthly Statistics
          – CDC
                • I-COADS 1° and 2° netCDF format files
                         – Through 1997 now, to be updated through 2002




    http://www.cdc.noaa.gov/coads/coads_cdc_netcdf.shtml



NODC, December 3. 2003               I-COADS Data and Products   13
    Data Availability

   • Monthly Statistics
          – CDC, Live Access Server (LAS), New
                • Interactive interface
                • Database – CDC I-COADS netCDF archive
                         – To be updated through 2002 soon
                • visualize
                • subset variables, choose output file format
                • compare (difference) data grids

    http://www.cdc.noaa.gov/coads-las/servlets/dataset

NODC, December 3. 2003               I-COADS Data and Products   14
    Data Availability, CDC LAS, Constraints Interface




NODC, December 3. 2003   I-COADS Data and Products   15
    Data Availability, CDC LAS, Output Options


 Choose Option

 2 Graphic

 NetCDF

 2 ASCII

 2 Spreadsheet

 GIS




NODC, December 3. 2003   I-COADS Data and Products   16
    Data Availability, CDC LAS, 1° 01/1970 SST Median




NODC, December 3. 2003   I-COADS Data and Products   17
    Data Availability, CDC LAS, 1°, SST Median,
    Jan.1983 – Jan.1989, Niño – Niña difference




NODC, December 3. 2003   I-COADS Data and Products   18
    Data Availability
   • Advanced Products and Analyses
          – New Adaptive QC trimming
                • Monthly SST, 2°x2°, 1800-1997
                • A few details
                         – Authors: Tom Smith (NCDC) , Xiao-Wei Quan (CDC)
                         – Observational outliers are trimmed according to a
                           reference climatology that varies with the climate signal
                         – See link for other details and publication references
                • Access from NCAR, binary or ASCII (subsets)


    http://dss.ucar.edu/pub/coads/forms/msg/msga.form.html



NODC, December 3. 2003                 I-COADS Data and Products   19
    Data Availability, Adaptive QC SST
   Decembers 1970-1997, 8-2S, 80-88W , Red = Trimmed Observations




                         30
     Original
     Trimming            20

         via             10
    fix climate
                         0


                                                      82-83         97-98



                         30
   Adaptive
   Trimming              20
      via                10
varying climate
                         0



NODC, December 3. 2003        I-COADS Data and Products       20
    Data Availability
   • Advanced Products and Analyses
          – Extended Reconstructed SST and SLP
                • Authors Tom Smith and Dick Reynolds (NCDC)

                • Monthly SST, 2°x2°, Global, 1854-2002, continuing

                 • Monthly SLP, 2°x2°, Global, 1854-1997

                   • Access from NCDC, ASCII format


    http://lwf.ncdc.noaa.gov/oa/climate/research/sst/sst.html

    http://www.ncdc.noaa.gov/oa/climate/research/slp/index.html
NODC, December 3. 2003          I-COADS Data and Products   21
    Plans
   • Transitioning archive to IMMA format
          – International Marine Meteorological Archive
            (IMMA)
          – Why?
                • IMMA is an ASCII format – easier to use?
                • Gaining acceptance by WMO – JCOMM Expert
                  Team for Marine Climatology
                • Encourage I-COADS data contributors to use it
                         – Insures accuracy from data providers
                         – Easier to grow I-COADS
                • Well documented, and proven successful
                         – Project examples: CLIWOC, RT at NCDC, NCEP GTS

NODC, December 3. 2003                I-COADS Data and Products   22
   Plans, IMMA
   • Basic format concepts                                         Historical data
                                                                   GTS data
Core segment – fixed length     +      Original data attachments
                                                                   Special formats
 Working Principles                                                Aux. QC info.
 • Core segment
     All commonly used variables
     Fixed length ASCII (108 characters)
     Alone will be sufficient for most users
 • Original data attachments
     Contains special fields not in Core
     Can be used to improve, repair, and recreate
         Core
 Great format for:
 • an irreplaceable data archive
 • ensure easy software access (ascii based)

  http:/www.cdc.noaa.gov/coads/e-doc/imma/

NODC, December 3. 2003        I-COADS Data and Products    23
    Plans, Real-time data for I-COADS
   • Observations from NCDC
          – Features
                • Based on NCDC GTS data stream
                • Web and FTP access
                • Pilot activation date: September 2004
                         – Fast access b/c database system
                         – Like online data selection at NODC?
                • Will include the full historical archive
          – Preparation so far
                • Cross-checks NCDC GTS and NCEP GTS streams
                         – show good agreement and mutual accuracy

NODC, December 3. 2003                I-COADS Data and Products   24
    Plans, Future data Inclusions
   • Much historical data to be added




NODC, December 3. 2003   I-COADS Data and Products   25
                              I-COADS Release 2.0, 2003
                              DM 1784-1997, RT 1998-2002
                              Future Candidates: red(undigitized), yellow (partly), green (fully)
                          8
                                                                                                         Polish Baltic: 1961- 90; 360K

                          7                                                                         Arctic Drift Stations: 1952-76
                                                                                                    US Navy Hourly: 1952-64; 3M
                          6                                                                    UK Marine Data Bank: 1950-79
Reports/Year (Millions)




                                                                                     Japanese Whaling Data: 1946-84; 30K
                          5              Japanese Kobe (2003 ed.): 1889-1940; 3.2M
                                    U.S. Meteorological Journals: 1878-94;1.8M
                          4     Arctic Norwegian Data: 1867-1912; 125K


                          3
                                         Fully digitized components to
                          2              be added to I-COADS

                          1


                          0
                           1790         1810         1830         1850          1870         1890           1910        1930         1950   1970   1990



  NODC, December 3. 2003                                                     I-COADS Data and Products                        26
                              I-COADS Release 2.0, 2003
                              DM 1784-1997, RT 1998-2002
                              Future Candidates: red(undigitized), yellow (partly), green (fully)
                          8


                          7


                          6
Reports/Year (Millions)




                          5


                          4
                                                                                           Ukrainian Hydrometeorological: 1958-85
                          3                                                  Russian R/V Marine: 1936-2002; 4-6M

                                                          US Lightship Data: 1891- recent
                          2                                    German Data: 1887-90; 30K

                                                                        CLIWOC: 1750-1850; 300K
                          1
                                   Partly digitized components to
                          0
                                   be added to I-COADS
                           1790         1810         1830         1850          1870         1890        1910      1930        1950   1970   1990



  NODC, December 3. 2003                                                     I-COADS Data and Products                  27
                              I-COADS Release 2.0, 2003
                              DM 1784-1997, RT 1998-2002
                              Future Candidates: red(undigitized), yellow (partly), green (fully)
                          8


                          7


                          6
Reports/Year (Millions)




                          5


                          4


                          3


                          2


                          1                                                           German Maury Collection: 1845-67; 500-750K


                          0        Undigitized component to be
                           1790    added to I-COADS
                                     1810    1830  1850    1870                              1890        1910     1930       1950   1970   1990



  NODC, December 3. 2003                                                     I-COADS Data and Products                 28
    Plans, Web Status and Developments
   • New “Data and Metadata Page”
          – New look
                • Organized by data products
                         – Eliminated the CDC/NCAR/NCDC structure
                • I-COADS metadata
                         – Software and documentation
                         – Graphics and figures to show I-COADS inventories
                         – Ship metadata – Pub47 (1973-1999)
                • Most products mentioned here are linked to this
                  page.


  http://www.cdc.noaa.gov/coads/products.html
NODC, December 3. 2003                I-COADS Data and Products   29
    Plans, Web Status and Developments
   • “Related Data and Resources”
          – Links to Projects and Organizations
                • VOSCLIM
                • CLIWOC
                • JCOMM
          – Links to Associated Data
                • JISAO Climatologies (Mitchell UW)
                         – 1° global
                • Extended Reconstructed Analyses (NCDC)

  Grow this area, link more projects and data
  http://www.cdc.noaa.gov/coads/related.html
NODC, December 3. 2003                 I-COADS Data and Products   30
    Conclusions
       I-COADS is international

       1998-2002 update available now

       Many access points and formats

       New analyses are available

       New format (IMMA) will be future standard

       I-COADS real-time observations – coming next year

       I-COADS benefits from NODC, and has common
       archive and distribution practices
NODC, December 3. 2003    I-COADS Data and Products   31
                         Thanks!




NODC, December 3. 2003    I-COADS Data and Products   32

				
DOCUMENT INFO
Shared By:
Categories:
Tags:
Stats:
views:0
posted:3/13/2012
language:
pages:32