Docstoc

Cool Facts About Auditory Displays_

Document Sample
Cool Facts About Auditory Displays_ Powered By Docstoc
					Cool Facts About Auditory
        Displays!

        March 29th 2007
      speaker: Martin Talbot




                1
       Definition
Auditory Display is the use of non-
speech sound to present
information
Auditory Display can be built by
means of Sonification or
Audification techniques




                2
          Audification
Definition: A direct translation of a data
waveform to the audible domain for purposes
of monitoring and comprehension.
Examples: Seismogram




                    3
           Sonification
Definition: The use of data to control a sound
parameter for the purpose of monitoring and
analysis of the data
Commonly implies using different synthesis
methods
Examples: Morse Code




                     4
   Sound Parameters
Definition: The individual dimensions of sound.
Sounds are defined by pitch, loudness, timbre,
envelope, duration, speed, modulation,
location in space...
Perceptually, these sound parameters are not
necessarily orthogonal to one another: i.e.,
altering one dimension may affect our
perception of other sound parameters


                    5
2 Type of Sonifications
 Auditory Icons: are natural sounds
 whose natural associations are used to
 map with the data. E.g. OS X’s Trash
 can sound.
 Earcons: are abstract, musical tones
 used in structured combinations to
 create sound messages. E.g. Jaws



                  6
Putting Things in
  Perspective




        7
Motivations for Auditory
      Information
 Visual system is overloaded, may be
 occupied, or unavailable
 Has superior ability to perceive temporal
 change and patterns
 Parallel listening
 Affords microstructure to be perceived; so
 it can rapidly perceive large amounts of
 data
                      8
Success Stories
 Seismology
 Geiger counter
 Sonar
 Morse code
 Pulse-Oximeter




           9
Common Applications of
    Sonifications
 Information Systems for the blind
 Process Monitoring Application
 Human Computer Interfaces
 Alternative to visual displays
 Exploratory Data Analysis


                     10
                 Design
Same Gestalt principles apply with sounds, for
instance:
    Similarity

    Proximity

    Good Continuation

    Belongingness

    Common fate

                    11
            Design (2)
point estimation: where the user must
determine the specific “y” value corresponding
to a given “x” value




                     12
  Design Most Common
         Issues
Context, mental model, polarity, unbalanced
displays...



                     sound
                  frequencies
                      (Hz)




                                 time (s)
                       13
Possible solutions:
Dynamic Beacons




         14
 Can we Convey Spatial
Information with Auditory
       Displays?

Short answer: yes
Long answer: well, ...



                     15
     Theory of Hearing
Sound localization is a function of pitch
Timbre discrimination is a function of pitch
The Place theory




                      16
   first, let’s listen to this
       complex sound


voltage
              one period




                 time
                17
   sound composition
summation

1*500 Hz

2*500 Hz

3*500 Hz

4*500 Hz

5*500 Hz

            18
Recap: pitch theory




http://www.blackwellpublishing.com/matthews/ear.swf

                            19
Sound localization



        20
The Mechanics of Sound
     Localization
Azimuth cue:
  Duplex theory
Elevation cue:
  Head Related Transfer Function (HRTF)



                  21
      Azimuth Cues:

Duplex Theory

 interaural time difference
interaural level difference


                22
       Duplex Theory

azimuth cues:
  duplex theory




                  23
       Duplex Theory

azimuth cues:
  duplex theory




                  24
         Elevation Cue

Elevation Cue:
  Head Related Transfer Function (HRTF)




                    25
                HRTF
Head Related Transfer Function (HRTF)




                    26
HRTF




 27
HRTF Capture




     28
29
  HRTF Most Common
       Models
Three popular methods to use HRTF
      individual
      generic
      best-fit




                   30
    So, can we Convey Spatial
     Information with Auditory
            Displays?
       Yes we can, but in practice elevation information is
difficult to convey, since everyone has different pinnae shapes
              (like everyone has different fingerprints).




                               31
Demos



  32
 Interesting Research
        papers
“the sonification of EMG data” s. pauletto &
a. hunt
“pattern in auditory design” c.
frauenberger, t. stockman)
“tangible data scanning sonification model”
T. Bovermann, et al.


                     33
                  demo # 1




biofeedback:
bioelectric signal & electromiography

                           34
The sonification of EMG
          data


               QuickTime™ and a
         YUV420 codec decompressor
        are needed to see this picture.




                                          the university of york, uk
                       35
                demo # 2




menus for four well
known application types
were implemented.

                          36
   pattern in auditory design



                              file edit format window help
                                        font
                                        text
                                           align left
                                           justify
Queen Mary University of London
                                  37
              Last Demo (#3)



 multimodal:
user is immersed in a 3D space of
invisible but acoustically active data
points activated by tangible
computing
                              38
tangible data scanning
  sonification model




   bielefeld university, germany
                 39
                ICAD


International Conference on Auditory Displays
http://www.icad.org/




                       40

				
DOCUMENT INFO
Shared By:
Categories:
Tags:
Stats:
views:9
posted:10/4/2011
language:English
pages:40