Slide 1 - SDSC

Document Sample
Slide 1 - SDSC Powered By Docstoc
					Mouse Brain Atlas Meeting
Use cases
  e.g. identify genes at a location, and expressing
  supporting workflows: data publication and
  registration, visualization, annotation (incl.
  collaborative delineation), single-slice, cross-slice
  and cross-scale query, integration at various
  Mapping the workflows to infrastructure
Registration (3d to 3d; 2d to 3d; based on
  coordinates; taxonomy (w/BIRNLex), a
  combination; cross-scale, etc.); image registration
  workflow; gene expression registration
Visualization: MBAT/WOMBAT
Integration: Interop API, mediator
Mouse BIRN: Brain Image Analysis Systems

 NeuroTerrain (Drexel)                        SMART Atlas
                            SHIVA (UCLA)

                                               BIRN Atlas
                                           Interoperability API
              MBAT (BIRN)
  3D Anatomical Analysis Software
The Harvard SPL Anatomy Browser / 3D Slicer
BRAINS2/IPL (The University of Iowa - another BIRN participant)
The Pitt Supercomp. Center Volume Browser (Wetzel et al.)
Mouse Brain Image Visualizer (MBIV) (Bennett et al. - used for Hof atlas)
ANFI (X11+Motif based medical imaging environment - including a volume browser)
AMIDE (Gnome-based anatomical volume browser)
Mayo Clinic's ANALYZE
BrainImageJava (Stanford Psych. Neuroimaging Lab) (UC Davis - though really 2D, it should be considered capable of interoperating in 3D the way SMART Atlas does - even it cannot do this now)
BrainVoyager QX (Rainer Goebel et al. atハBrain Innovation B.V., Maastricht, The Netherlands)
Brede (Finn 〉up Nielsen -ハIMM, Tech. U. of Denmark - XML-based from the outset)
CARET/SumsDB (David van Essen, John Harwell, et al. - Wash. U. St. Louis)
NCMIR 3D Visualization Tools
XANAT/Conexus/Large-Scale Viz (UCDavis/Stanford Psych/UCI)
FMRIDC Tool (Dartmouth)
DPTools (Denis Ducreux - France)
EM3D (U.J. McMahan - Stanford Neurobiology)
/Imaris (Bitplane AG)
Amira (Mercury Computer Systems)
/FormZ (auto-des-sys)
itk-SNAP (currently - Penn Image Computing & Science Lag, Radiology, U.Penn)
Java Image Viz (JIV - McGill U.)
MRI3DX (Aston U., Birmingham UK)
MRIView (Los Alamos NL)
NeuroLens (MGH Martinos Imaging Center)
NMV (Neuromorphometrics, Inc. - somewhat SMART Atlas-like)
OsiriX -
Skandha4/Brain Visualizer (U. Washington, Structural Informatics Group)
SPM5 (UCL,ハWellcome Department of Imaging Neuroscience - U )
SurfRelax (NYU)
Volume One (VOLUME-ONE developers group, Japan - OpenGL/gtk+)
VoxBo (U. Penn.)
VTK CISG Registration Toolkit (Thomas Hartkens,ハGuy's Hospital, UC London - )
Volume Visualization and Navigation Tool
WFU PickAtlas (Wake Forest U., ANSIR resource)
 Web-oriented Mouse BIRN Atlasing Tool
BIRN Atlas Interoperability API
    Promotes Re-use & Integration
    Messaging to synchronize & share
        •   atlas data set selection
        •   current atlas position
        •   VOIs - object geometry & ontology-based labels
        •   integrated analysis of brain section data sets
            aligned to any given atlas

    Messaging implementation
        • generators & listeners
        • process monitoring and control
        • WSDL web-services + binary attachments
NeuroTerrain Atlasing System
2005/2006 Progress Report
   NT Atlas Server
      • Re-architected as ANSI C/C++ Unix daemon app

      • Integrates Macrovoxel atlas data sets with brain
        region VOIs in a unified coordinate space

      • Responds to client slice requests via TCP
        socket-based data stream

      • Tuned for optimal performance under low & high
        network latency (local LAN vs. public Internet)

      • Tools for building Macrovoxel data sets
NeuroTerrain Atlasing System
2006/2007 Plans
   NT Atlas Server
     • Integrated, seamless zooming of aligned multi-
       dimensional data sets
     • Tools to integrate user-submitted brain
     • Implementation of the BIRN Atlas Interoperability API
     • Dedicated NT Server (dual 2GHz XNode) at BIRN-CC
     • Tools for tighter integration of VOI definitions with
     • Web service-based access to NT atlas aligned
       datasets (e.g., the Mouse Brain Library, etc.)
NeuroTerrain Atlasing System
2005/2006 Progress Report
  NetOStat Client (NT-SDK)
    • Re-architected as a Java-based dev kit components
      for integration in any Java application - client or server
           • NetOStat application serves as developer template

    • Provides complete implementation of the NT
      Server API
           • Select data set, slice data at arbitrary angles, switch
             slice axis (C/H/S), zoom & pan, view selected VOIs,
             save images, reslice for segmentation

    • Tuned for optimal performance under low & high
      network latency (local LAN vs. public Internet)
NeuroTerrain Atlasing System
NetOStat Client (NT-SDK)

Mac only

              To platform independent Java
NeuroTerrain Atlasing System
2006/2007 Plans
  NetOStat Client (NT-SDK)
    • Complete bi-directional implementation of BIRN Atlas
      Interoperability API in NT-SDK
    • Complete simultaneous, multi-session capability
    • Complete multiplatform testing - Windows, Linux,
      & Webstart
    • Continue network tuning
    • Web-service client to SRB & Mediator
    • Link with NT Image Repository server - deliver NT-
      aligned data sets to any implementing application
Recent Additions to MBAT (UCLA)

Bonfire Browser
  – Query Bonfire server, display results

Improved Brain Graph Editing and Display

Integrated Gene Expression Tool
  –   Query/display individual user data on BIRN
  –   uArray Server
  –   GeneNetwork
  –   BIRN CC Mediator (Barlow/Zapala data)
MBAT – Future Plans (UCLA)

Expand annotation searching for gene
Query/Display in-situ images
Add 2d <-> 3d interface with NeuroTerrain
 Server and Smart Atlas
In the last 6 months (UCSD)

Closed the loop on image registration
  – Image registration workflow on the portal
  – Spatial registry in Oracle Spatial, with WS API
  – Load an image into Jibber – define registration points
    and compute transformation matrix – warp with Jetsam
    – serve the warped image as ArcIMS service – update
    record in spatial registry (including SDO, thumbnails,
    etc.) – discover the image by querying from Smart
  – Components implemented as web services, callable
    from other apps
The Bonfire module in SA and MBAT

• Step 1: Select
  an image in
  SRB, and start
  warping with
                    • Step 2: After
                      warping is done,
                      spatial registry is
                      updated to reflect
                      it; warped images
                      are listed …

… select a warped
 image for
 conversion to
 image service
                    • Step 3:
                      Review image

… and spatial
 metadata in
 spatial registry
                    • Step 4: Find the
                      image in spatial
                      registry …

… by specifying a
 search shape in
 Smart Atlas
Development Ideas (UCSD)
Registering more images in the spatial registry, testing, validation…
Tools for data curation in spatial registry
Registering 3D volumes in a similar fashion
Integrating 3d cutting tools
Registering oblique slices
Web services and workflows for registering other data types, modeled
   after image registration
Wrapping spatial selection requests as Web services
Atlas interoperability API and server: connection with mediator API
Portalizing atlas functionality
BIRN-enabled tools (plugins for Photoshop, Excel, to allow
   upload/search/download from BIRN – need a survey of popular
Exchanging relative location information, for cross-scale communication
Better organization of ArcIMS image services, and serving images in
   OGC-compatible formats
Using ERMapper IWS or ESRI's Image server to serve large BIRN
   images into Photoshop and web clients
BIRN Tools                          Define a selection
                                   polygon in MBAT (2D
                                          or 3D)
             Find by Location
             Find by Taxonomies
             Upload and Register    Open an attribute
                                     selection form,
                                     w/Bonfire etc.

                                     Authenticate and
                                        start image
                                   registration workflow