CIC VWG Briefing by lDHb86

VIEWS: 5 PAGES: 38

									Architectures:
From Video Storage to
Campus Rich Media Services

      Alan McCord and Dan Hague
         University of Michigan
         SURA/ViDe Conference
            March 26, 2003
7/27/2012 2:18 AM   SURA/ViDe     1
    Agenda
   0-10 minutes
       Introductions, Al setting the stage for Dan
   11-30 minutes
       Dan describing his IP SANS solution
   31-50 minutes
       Al weaving the IP SANS solution into a model
        architecture for rich media on campus
   51-60 minutes
       q/a and discussion

7/27/2012 2:18 AM        SURA/ViDe                    2
    Introduction
   Individual campus video projects can
    easily require many Gigabytes of storage
    for even a short ten-minute asset. Once
    stored, those assets need to be cataloged,
    streamed and otherwise re-purposed.




7/27/2012 2:18 AM    SURA/ViDe              3
  Remember This Scene?
                                            Digital video
      Tape of
                                             of patient
       1975
                                             interview
     orchestra
      concert
                      Brent
                                                  1962 Robert
                    Scowcroft
                                                  Frost poetry
                      dialog
                                                    reading

  Championship
   field hockey
                                               Yesterdays’
       game
                                                CHEM101
                                                 lecture



7/27/2012 2:18 AM               SURA/ViDe                        4
    The Campus Challenge
   We need to acquire, index, access, use,
    and archive “perishable IP” for
       Course delivery (on-campus and DL)
       Archives and collections
       Research projects
       External communications (Web,
        Broadcast, and print)

7/27/2012 2:18 AM      SURA/ViDe              5
    Why DAMS Is Important
   Our networks can support digital video payload
   Students use P2P to manage media assets
   BUT
      Rich media still absent from most instruction

      Lack of large-scale rich media services

      Faculty and librarians lack experience / tools
       for managing rich media individually or
       institutionally
      Lack of tools to manage IP rights

      Lack of rich media workflow tools


7/27/2012 2:18 AM       SURA/ViDe                   6
    How Do We Do This?
   A campus-wide collaborative approach
   Metadata standards
   Ingestion, cataloging, and retrieval tools
   Lots of bandwidth
   Lots of storage
       Disk attached storage (DAS) inexpensive but lacks
        speed and scalability
       Traditional storage area networks (SAN) are difficult
        to manage in highly decentralized organizations
       IP-based iSCSI storage may serve campus-wide
        needs for fast, inexpensive, scalable video storage

7/27/2012 2:18 AM           SURA/ViDe                       7
eStorage - UM Mass Storage

     Large Scale storage as applied to
    the Unified Messaging project and
      the Video Storage, Logging and
             Retrieval solution

7/27/2012 2:18 AM   SURA/ViDe            8
      Unified Messaging

    High Availability
    Redundant Architecture
    Scalability Port
    Load Balancing Between Ports
    Load Balancing Between Switches



    7/27/2012 2:18 AM   SURA/ViDe      9
    Video Storage, Logging, Retrieval
   “Huge” Storage Volumes (68 GigaByte up
    to 1 TeraByte)
   Performance & High Throughput
   IP Network Centric
   Standards Based
   Utilize UM Purchasing to drive down costs



7/27/2012 2:18 AM    SURA/ViDe             10
      High Availability
    If one switch fails the hosts are served
     by the redundant switch.




    7/27/2012 2:18 AM   SURA/ViDe               11
      Redundancy

   Redundant Power Supplies
   Redundant Cooling Fans




    7/27/2012 2:18 AM   SURA/ViDe   12
    Scalability Port
   To cascade between switches there is a
    scalability port that allows the creation of
    a director class switch.




7/27/2012 2:18 AM     SURA/ViDe               13
    Load Balancing Between Ports
   Four (4) FC storage ports are available per
    switch.




7/27/2012 2:18 AM    SURA/ViDe              14
    Load Balancing Between Switches
   The load can be spread over multiple switch
    ports
   Each switch has 3 GigE ports
   Each switch has 4 FC ports or 6 SCSI ports




7/27/2012 2:18 AM      SURA/ViDe                  15
    Huge Storage Volumes
   4 each JBOD chassis
   28 each 73 GigaByte
    FC drives (68Gig after
    formatting)
   2 each controllers /
    switches development
   2 each controllers /
    switches production



7/27/2012 2:18 AM       SURA/ViDe   16
    Performance and High Throughput

   7000 packets per second using 1500 Byte
    packets ~ 84 M throughput
   11,000 packets per second in other tests
   MPEG-2 4:2:0 remove video encoding
    from the Media Union to Arbor Lakes
   Clustering of MS Exchange Servers to
    support Unified Messaging


7/27/2012 2:18 AM   SURA/ViDe             17
    IP Network Centric
   Dedicated Fibre Channel SAN islands are
    becoming a thing of the past
   Leverage large qualified support staff that
    support existing campus IP network
   Storage is available on demand to IP
    connected devices from any high speed IP
    faceplate


7/27/2012 2:18 AM    SURA/ViDe              18
    Standards Based
   iSCSI draft standard has been ratified by
    the ITEF and new beta products are
    showing up every month
   Microsoft will include the iSCSI driver in
    Windows2003 (previously Windows.net)
   Cisco and IBM will continue to deliver
    iSCSI drivers until the OS versions are
    stable

7/27/2012 2:18 AM     SURA/ViDe              19
    Additional Storage via UM Purchasing

   Traditional vendors require storage
    upgrades to be purchased from the switch
    manufacturer
   2 more Terabytes are needed and the
    acquisition will go through UM Purchasing
   More vendors are entering this market
    every quarter driving down the cost


7/27/2012 2:18 AM    SURA/ViDe            20
    More Information
   WGBH - PBS television station in Boston
    http://daminfo.wgbh.org
   University of Michigan DAMS Initiative
    http://sitemaker.umich.edu/dams
   iSCSI Storage Switches
    http://www.sanrad.com
   Unified Messaging Project
    http://www.cti2.com

7/27/2012 2:18 AM    SURA/ViDe                21
    Storage Summary
   We are applying iSCSI storage today for:
       Unified Messaging
       Video on Demand
   We are looking at applying iSCSI for:
       Archiving 70,000 .wav files for the hospital
       Increasing the storage on existing NAS servers
        internally within our department
       Driving down the cost of file storage to allow the
        DAMS solution to reach more students and faculty




7/27/2012 2:18 AM           SURA/ViDe                    22
    What Are We Up To?
   Potential DAMS “early wins”
      Course management systems

      Digital libraries

      Personal > unit > institutional repositories

   Evaluating three COTS DAMS product
    suites
       DAMS not a core competency
       Leverage developer investment
       Focus on open standards and tools

7/27/2012 2:18 AM        SURA/ViDe                    23
    Market Segments
   Content repositories (brand management)
   Workflow management (marketing production)
   Content and version control (Web production)
   Digital media ingesting and logging
   DAM infrastructure tool suites
   Digital rights management
   Encryption and content distribution systems
   Systems integration services
   Hosting services

7/27/2012 2:18 AM     SURA/ViDe               24
    What Are The Components?
   Integrated repository for content & metadata
   Infrastructure to manage digital media assets
      Ingesting and format conversion *

      Metadata tagging and cataloging *

      Searching and retrieval

      Packaging and delivery to creative and
       production environments *
      Managing flow and control of assets *

      Managing IP rights and rules *




7/27/2012 2:18 AM      SURA/ViDe                    25
                 What DAMS “Is” To Us
                                          Digital Asset
                                          Management                                                    Content
                                                                                                     Management and
                                                                                                       Production
                 Media Assets
                   Database




                                                                                                                           Audiences
  Search                        Preview and Edit          Production                 Publish/Distributio
  Assets                                                                                     n
                                                                                                                      Web - Internet
                                                                                                                      Web - Intranet
                                                                                                                      Internal UM Information
                                                                                                                      External Publications
Search on:                      Parallel preview                                        Translate                     Controlled Access
                                (thumbnail) and           Edit tools
• Text content                                                                          •HTML
                                Rich-data view:           Application tools and
• Keywords                                                integration of industry       •XML
                                •File/Asset size
• Speech                                                  standard tools for            •Text
                                •Compression type         applications where
• Sound/music                                             requested by customer         •Video formats
  patterns                      •Quality
                                                          (e.g., MS Word, Avid          • Audio formats
• Image                         •Language                 Media Composer, Adobe
  descriptions                  •Translation              PhotoShop, etc.)
                                                                                        Publish
                                                          •Content
                                Preview edit                                            •To multiple media
“More like this”                                          •Size                         formats
  search on:                    •Compressed               •Cropping
• Image content                 format
                                •Rich format              •Output Format/File type       Distribution via
• Audio content
                                                                                        •Network
• Video content
                                Rights & royalties                                      •User-defined industry
                                                                                        standard output devices
                                •Searchable                                             (DAT, BETA-SP, ZIP,
                                •Display                                                CD-RW, etc)
                                •Reporting
         7/27/2012 2:18 AM                                     SURA/ViDe                                                             26
    Ingesting Assets
   Static assets
       Image, text, web,
        dataset
       Auto / bulk ingest
       Format conversion
   Video assets
       Tape, live, digital
       Format conversion
       Auto ingest
       Virage integration

7/27/2012 2:18 AM             SURA/ViDe   27
    Multiple Metadata Schemas
   Instructional objects
       SCORM / IMS
   MPEG 7
       Merged video content and metadata
   MPEG 21
       E-Commerce / DRM metadata
   Institutional repository
       Dublin Core, MARC
   Discipline-specific and project-specific schemas

7/27/2012 2:18 AM           SURA/ViDe             28
    Re-Packaging Assets
   MS Office plug-ins
   Quark plug-ins
   Imports into
    Dreamweaver
   FTP and e-mail
    packaging
   EDL files for   Event Tape  Audio/ Edit
                                Video   Action
                                               Time Code




    video editors
                                Tracks
                    NAR -- THROUGHOUT HISTORY...PEOPLE AS WELL
                    001   AX    A2/V     C     00:00:10:00 00:00:13:0001:00:00:00   01:00:03:00
                    DAWA SONAM IN GROUP

   XML wrapping    002   P17   A2/V     C     01:00:08:07 01:01:20:0901:00:03:00
                    NAR -- THESE PEOPLE...TOWN MEETINGS
                    003   15    A2/V     C     15:02:17:00 15:02:36:0001:01:15:04
                                                                                    01:01:15:04

                                                                                    01:01:34:04
                    WIDE SHOT
                    004   15    A2/V     C     15:10:00:00 15:10:06:0001:01:34:04   01:01:40:04




7/27/2012 2:18 AM                SURA/ViDe                                                        29
    Workflow Tools
   Auto-ingest and
    initial tagging
   Multi-stage
    tagging
   Content
    assembly
    and approval
   Automated
    notification
   Archiving
7/27/2012 2:18 AM     SURA/ViDe   30
          Digital Rights Management
                        Individual Domain
                                                                    COLLABORATIVE RESEARCH

STUDENT RESEARCH
                        Project or Group Domain
                                                                              COURSE TOOLS DELIVERY           MEDIA STORY
                               Department Domain

                                   School/Unit Domain
                                                                                                      Public Domain
                                          Campus Domain

                                                                                                                    Security/Privacy/Authentication

                                                                                                         Ingestion/Metadata Creation




                                                        Metadata/Indexing/Query Management


                                                                                                               Text, Graphics Images
               Video in multiple
               resolutions
                                                                                    Audio in multiple resolutions
                                                                                                                      Entire Existing Databases
                                                         Executable Programs and
                                                         Complex Applications
                                                        Digital Media Assets Database
      7/27/2012 2:18 AM                                             SURA/ViDe                                                                         31
    What We’ve Done
   Established advocacy / evaluation team
   Constructed “phase one” demo lab
   Gained executive support
   Linked with campus / higher ed DAMS
    initiatives
   Conducted market review
   Established vendor relationships
   Issued RFP

7/27/2012 2:18 AM    SURA/ViDe               32
    Where We Are Today
   Received and reviewed five proposals
   Evaluation team narrowed field to
       Artesia / Sun
       Documentum / BearingPoint (KPMG)
       Ancept / IBM (Content Manager)
   Day-long campus visits
   Hands-on experiences and site visits
   Decision in process “as we speak”
7/27/2012 2:18 AM    SURA/ViDe             33
    Where We’re Headed
   eTools Collaboratory Components
                                                                                Unit                                                                Typical cycle of shared
                                                                                  Unit                                                              development resource
                                                                                     Unit
Survey Teams are                                                                            Unit
“portfolio” assignments for                                                                        Unit
eTools staff and include
many Unit participants                                                     Staffing is done at the level of “Projects” and “Service Nodes”




                                                                                                                         Project Support Services
                              Digital Rights Management                                                                                                         DAMS/COMPS Implementation


                                                                         Digital Asset Management System
                              Streaming Media                                                                                                                   LILI Production
                                                                         (DAMS)


                              Emerging Digital Video
                              Standards and Tools
                                                        Progress of
                                                        Information,     Content Management and       Progress of
                              Emerging Web              Knowledge,       Publishing System (COMPS) Shared Applications                                          Media Ingestion & Transcoding
                              Standards and Tools      Shared Vision,                                Development
                                                       Guding Beliefs
                              Workflow Best Practices                                                                                                           Specialty Output


                                                                        Digital Broadcast Production Systems
                              Sprite Technology                         (DIBS)



                              VR: Tactile, Spatial, Olfactory                                                                                                   Event-based Multimedia
                                                                                                                                                                 - Academic (RSC, panels)
                                                                        Location-independent Learning Integration                                                - Performances
                                                                        (LILI)                                                                                   - University (Commencement)



                   Survey Teams                                                   Projects                                                                     Service Nodes
      (Emerging Standards, Technology, Tools)

7/27/2012 2:18 AM                                                           SURA/ViDe                                                                                                           34
    Limiting Factors
   Common understanding about metadata and
    asset life cycles
   Storage
       “Two-tailed order of magnitude problem”
   End-to-end bandwidth
       Both on- and off-campus
   Diverse document types and platforms
   Asset capture and ingestion tools
   Availability of tech & user support

7/27/2012 2:18 AM          SURA/ViDe              35
    Fire-starters
   Convergence of DAMS and library systems
   Widespread use of consumer digital video
    capture and editing tools / appliances
   Development of easy-to-use transcoding tools to
    re-purpose rich media for multiple desktops
       Wireless phones
       tablet computers
       classroom projection systems
       etc.


7/27/2012 2:18 AM          SURA/ViDe            36
    Impact on Video Services
   Video capture / encoding provides content for
    ingestion into repository
   Streaming will support retrieval / packaging
   Exposing rich media to creative users will drive
      Video capture, encoding, transcoding

      Streaming services

      Network bandwidth on- and off-campus

      Mass storage

      New services and service levels


7/27/2012 2:18 AM       SURA/ViDe                  37
Closing Discussion

           U-M DAMS Initiative
       sitemaker.umich.edu/dams/
           amccord@umich.edu
           dhague@umich.edu

7/27/2012 2:18 AM   SURA/ViDe      38

								
To top