Docstoc

SMART SPACES TESTBED

Document Sample
SMART SPACES TESTBED Powered By Docstoc
					SMART SPACES TESTBED

                 Marty Herman, Chief
          Vince Stanford, Computer Specialist
INFORMATION ACCESS AND USER INTERFACES DIVISION



NATIONAL INSTITUTE OF STANDARDS AND TECHNOLOGY
                    Smart Space

• Embedded with computers, information appliances, multi-
  modal sensors
• Allows people to work efficiently through unprecedented
  access to information and help from computers
• Work can be done collaboratively or individually
        Characteristics of Smart Spaces
Situation Awareness
         Identify and perceive users and their actions and goals
         Understand and anticipate user needs
         Uses speech and natural language understanding, computer vision, multi-
         modal fusion

Information Access
         Facilitate interaction with information-rich sources
         Allow rich, natural forms of interaction between humans and computers
         Provide multi-media (e.g., text, voice, images, video) information extraction

Information presentation
         Provide extensive capabilities for presenting information in an optimal and
         integrated manner
         Provide immersive presentation capabilities
        Characteristics of Smart Spaces
                     (cont.)
Collaboration
         Provide for collaborative working environment
         Increase the rate of information interchange among users
         Permit mobile workers to interact and participate in smart space
         activities

Mobile computing
         Provide for use of mobile devices and receivers, allowing ubiquitous
         “anywhere, anytime” access
         Provide for discovery and integration of mobile devices with smart space
         infrastructure

Record keeping
        Provide improved memory of activities and deliberations for later use
        Record and summarize dialogue, activities, and events
      Create Smart-Space Integration
             Testbed at NIST
• Showcase future of Smart Space technologies
• Integrate component technologies for demos
• Develop and apply measurement and testing approaches
• Develop and test prototype standards (e.g., interface
  standards)
• Develop test collections to support evaluations
• Infrastructure for industry and academia to work hand-in-hand
  with NIST
• Facilitate adoption by industry
 NIST Smart Spaces Testbed Scenario:
        Smart Meeting Room
• Room understands and guides meeting participants
• Senses who is talking to whom and where they are located
• Realizes when information is requested and outputs information
  that seems to be useful
• Engages in dialogue with participants to get more information
• Room connected to Internet and digital libraries/databases
• Personal information from palm/pocket computers are integrated
  into room’s information infrastructure
• Information displayed on information appliances and wall displays
• Room aids in collaboration both within the room and with field
  personnel
•Situation awareness
•Speech, natural language input
•Computer vision input
•Integration of handheld computers into room
•Retrieval & visualization of information
•Distributed collaboration
                Smart Meeting Room
Applications:

•      Business meeting room
•      Medical consultation meeting room
•      Training and education facility
•      Military command center
•      Crisis management command center
                       Role of NIST

Smart Spaces is an emerging research area. Many of its
component technologies require research to advance the state of
the art. NIST can provide the following:

       • measurement methods
       • testing and evaluation approaches
       • benchmark tests
       • reference materials (test data and test protocols)
                    Role of NIST
                       (cont.)

Many technology suppliers will be required to make the vision
of Smart Spaces a commercial reality.

To encourage commercial innovation, NIST can work with
industry to provide open interface standards for
interoperability.
          Near Term Smart Space
• Experimental Collaborative interface using:
   – Microphone array, with beam fan, for acoustic signal
     acquisition
   – Acoustic source location and tracking
   – Continuous speech recognition (CSR) using single
     channel reduced from array
   – Speaker identification combined with CSR for
     collaborative groups
   – Shared high resolution visual interface with information
     visualization
            Near Term Smart Space
                    (cont.)

• Experimental Collaborative interface using:
   – Video camera array to identify, locate and track
     individuals in the smart space
   – Video teleconferencing
   – Initial test case will use several functions:
       • Broadcast news transcription
       • Real time spoken query processing
       • Information retrieval using BN transcripts
                            Current Status...
•   Lab space allocated; construction begins:     •   External cooperative research efforts:
     – Initial smart space November 23                  – Microphone array/acoustic source locator
     – Acoustically conditioned space 1Q99                  from Rutgers CAIP; Jim Flanagan P.I.
•   Computing, display, sensing infrastructure:         – BBN and IBM offering research and real
     – Dual Processor SGI Octane                            time speech recognition
           • 640Mb Ram                                  – Investigating possible use of MIT speaker
                                                            identification
           • thirty-two channels A/D
                                                        – Investigating possible use of U of Md visual
           • Dual camera inputs                             localization and gesture recognition
     – 1280x1024 large screen projector           •   Internal cooperative efforts:
     – Parallel Linux cluster:                          – Information retrieval (PRISE)
           • 112Gb disk array                           – Spoken document retrieval with spoken
           • Seven 400Mhz P-II compute nodes                query (SPIDERS)
     – Gigabit Ethernet switch in room                  – VRML smart space representation
     – Microphones:                                     – Information visualization
           • Desktop                                    – Face recognition technology
           • Wall mounted array(s)
     – Cameras:
           • Three computer controlled
           • One digital fixed mount
     – 384Kb video teleconferencing
     – Wireless connection/Palm Pilot
              Desired Long Term
            Capabilities/Technologies
•   Accurate, robust speech recognition for transcription and command
•   Anticipatory Web and database query based on speech
•   Speech understanding:
     – Spoken dialog abstraction
     – Selective recording of meeting minutes
•   Data stream segmentation/annotation
•   Face/expression recognition
•   Persistence of meeting memory, automatic links to related meetings
•   Sensor fusion (acoustic/visual/other)
•   Smart white boards
•   Image understanding and person recognition
•   Participant sensing, task identification, and adaptive response
       Metrics and Metrics Research
                 Needed
• End-to-end metrics needed for multi-stage processes, e.g.: Full
  SDR
   – Sensing
   – Recognition
   – Understanding
   – Response
• Training and test reference data sets needed for:
   – Component recognition tasks, e.g.: CSR, speaker ID, gesture
     recognition
   – Data reduction, e.g.: array processing and source location
   – Information extraction and summary
       Metrics and Metrics Research
              Needed (cont.)

• Initial Smart Space is needed as test bed to bootstrap future
  improvements
• Command/Crisis Management may offer measurable,
  reproducible tasks
• Need well defined tasks with solution quality, time, and labor
  level measurements
   Interoperability Issues are Severe
• Rapid handheld appliance discovery and connection to IP
  infrastructure, e.g.: IP masquerading or NAT
• Dense wireless device deployment:
   – IR
   – RF
• Multi-resolution devices and displays
• Device protocol discovery, automatic translation among
  heterogeneous protocols used by multiple devices
• Multimedia output into the space and acoustic input
• Security and accessibility to and by infrastructure

				
DOCUMENT INFO
Shared By:
Categories:
Tags:
Stats:
views:10
posted:10/21/2011
language:English
pages:19