Docstoc

audio Nonspeech Audio Agenda

Document Sample
audio Nonspeech Audio Agenda Powered By Docstoc
					Nonspeech Audio
Agenda

Questions?
Nonspeech audio
     science of sound
     framework for sound output
     display techniques
     applications
How to combine with visual interfaces?

1/25/99             CS 6751 Winter 1999
How would you design...
Anesthesiologist display
Display for monitoring background computer
 activity
Allow blind users to use GUIs
Monitor a bottling factory
Display chemical spectra readings
Listen to mathematical formulas
Understand parallel programs
1/25/99          CS 6751 Winter 1999
Perception of Sound

Tones, noise bursts
     frequency, waveshape, amplitude
Music
     timbre, harmony, melody
Sound effects (everyday)
     sources, events, environment
What can you hear? Groupings?
What is ok? What is urgent?

1/25/99                CS 6751 Winter 1999
Framework for Using Sound

 Exclamation
     signal to noise, urgency
 Deixis
     “beep,” still need context
 Simile
     frequency to vertical, amplitude to size
 Metaphor
     geiger counter
 Onomatopeia
     imitates the sound event

1/25/99                      CS 6751 Winter 1999
Ecological Approach to Listening

Auto approaching
Interaction of materials in an environment
Why an ecological approach?
Physics of sound-producing events
     vibrating solids
     aerodynamic events
     liquid sounds

1/25/99            CS 6751 Winter 1999
Understanding Everyday Sounds

What do Foley artists know?
Levels of sound identification
Action or object
Cultural (movies)
context context context
What is “real sound?”
Storytelling
1/25/99          CS 6751 Winter 1999
Display techniques

Sonification
Earcons
Auditory icons




1/25/99           CS 6751 Winter 1999
Sonification

Map numerical data to “classical”
 attributes of sounds
Time-varying and multivariate data
What can you hear better than see?
     patterns
     temporal information


1/25/99             CS 6751 Winter 1999
Earcons

Structured combinations of sounds to
 create audio messages
Ability to “layer” and structure sound
MathTalk (Stevens)
GUI feeback (Brewster)



1/25/99          CS 6751 Winter 1999
Auditory Icons

Everyday sounds - build analogies
Intuitive metaphor
     SonicFinder (Gaver)
Adds realism / presence
Difficult to design/implement



1/25/99             CS 6751 Winter 1999
Blind users

Chemical spectra measurements (Lunney)
MathTalk (preview)
Access to GUIs
     Soundtrack (Edwards)
     Mercator (Mynatt)




1/25/99            CS 6751 Winter 1999
Alarms

Masking
Encode information
Don’t turn the alarm off
Don’t forget about it
      change patterns
      increase urgency


1/25/99             CS 6751 Winter 1999
Monitoring

Get attention - EAR
Background awareness - ShareMon
Eyes/hands busy - Body Electric
Shared state - ARKola




1/25/99        CS 6751 Winter 1999
Upcoming

Natural UI
Using Metaphors




1/25/99        CS 6751 Winter 1999

				
DOCUMENT INFO
Shared By:
Categories:
Stats:
views:7
posted:6/13/2011
language:English
pages:15