Participatory Approaches to Sonic Interaction Design

Document Sample
Participatory Approaches to Sonic Interaction Design Powered By Docstoc
					                            Participatory Approaches to
                               Sonic Interaction Design


Karmen Franinovic
Interaction Design / Game Design, Zurich University of the Arts + Zero-Th Association
  Overview




   1. The Third Space of Sonic Interaction Design

   2. Methods for Interdisciplinary SID Workshops

   3. Conclusions




cost298                            karmen.franinovic@zhdk.ch   IAD Zurich University of the Arts
  Participatory Design as the Third Space

   USER >>>>>>> PARTICIPANT




   Michael J. Muller, Participatory design: the third space in HCI, The human-computer interaction handbook: fundamentals, evolving
   technologies and emerging applications, Lawrence Erlbaum Associates, Inc., Mahwah, NJ, 2002



cost298                                            karmen.franinovic@zhdk.ch                               IAD Zurich University of the Arts
  Participatory Design: Focused on Visual and Cognitive




cost298                  karmen.franinovic@zhdk.ch   IAD Zurich University of the Arts
  Participatory Design as the Third Space between Disciplines

   RESEARCHER >>>>>>> PARTICIPANT




   Michael J. Muller, Participatory design: the third space in HCI, The human-computer interaction handbook: fundamentals, evolving
   technologies and emerging applications, Lawrence Erlbaum Associates, Inc., Mahwah, NJ, 2002



cost298                                            karmen.franinovic@zhdk.ch                               IAD Zurich University of the Arts
  SID : An interdisciplinary Field
                                             auditory
                       tangible              displays                   music
                     interaction                                      interfaces

                                                                              enactive
           everyday
          applications                                 human                 interfaces
                                   design             computer
                                                     interaction                   haptics
   affordances

                                   music           ethnography
      sensorymotor                                                              sound
        response                    and                and                    perception
                                    arts            psychology
            performance                                                     sound
                                                                          perception
                             participation                 social
                                                        interaction

cost298                               karmen.franinovic@zhdk.ch              IAD Zurich University of the Arts
 Sonic interactions in everyday life


      1. Creating or revealing new experiences with a product




                                     Shoe                       Sensor                  iPod                Receiver




    K. Franinovic, Y. Visell, D. Hug. “Sound Embodied: A Report on Sonic Interaction Design in Everyday Artefacts”. The 13th Int. Conference on
    Auditory Display. Montreal, 2007.

cost298                                             Karmen Franinovic                                       Zurich University of the Arts
 Sonic interactions in everyday life


      1. Creating or revealing new functionalities in a product

      2. Shaping the sonic appearance of an artifact




    K. Franinovic, Y. Visell, D. Hug. “Sound Embodied: A Report on Sonic Interaction Design in Everyday Artefacts”. The 13th Int. Conference on
    Auditory Display. Montreal, 2007.

cost298                                             Karmen Franinovic                                       Zurich University of the Arts
 Sonic interactions in everyday life


                1. Creating or revealing new functionalities in a product

                2. Shaping the sonic appearance of an artifact

                3. Enhancing physical engagement in the interaction




    K. Franinovic, Y. Visell, D. Hug. “Sound Embodied: A Report on Sonic Interaction Design in Everyday Artefacts”. The 13th Int. Conference on
    Auditory Display. Montreal, 2007.

cost298                                             Karmen Franinovic                                       Zurich University of the Arts
  What challenges?

      INTERACTION DESIGN WITH SOUND

          New opportunities


          New challenges are at the core of research:
             - embodied
             - situated
             - multisensory
             - continuous ...




cost298                         karmen.franinovic@zhdk.ch   IAD Zurich University of the Arts
  Research Topics: Tangible Interaction




cost298                    Karmen Franinovic   Zurich University of the Arts
  Research Topics: Action-Sound Coupling




cost298                  Karmen Franinovic   Zurich University of the Arts
  Research Topics: Multisensoriality




cost298                     Karmen Franinovic   Zurich University of the Arts
  Research Topics: Situatedness




cost298                   Karmen Franinovic   Zurich University of the Arts
  Research Topics: Designing Temporal Processes




cost298                  Karmen Franinovic        Zurich University of the Arts
  Overview




   1. The Third Space of Sonic Interaction Design

   2. Methods for Interdisciplinary SID Workshops

   3. Conclusions




cost298                            karmen.franinovic@zhdk.ch   IAD Zurich University of the Arts
  SID Workshops
   - Goal
        create the third space in order to focus different disciplines on the SID topic

   - 8 hands-on workshops (1-14 days)
   - Venues: NABA, Oboro, ZHdK, KTH etc
          different languages (disciplinary and national)
   - Audience
          psychologists, computer scientists, engineers, archeologists, sound designers, artists,
          communication and cultural studies researchers...




cost298                              karmen.franinovic@zhdk.ch              IAD Zurich University of the Arts
  Analytic / Creation Methods: Voicing the Object




cost298                  karmen.franinovic@zhdk.ch   IAD Zurich University of the Arts
  Field Methods: Sound Postcards and Action Postcards




cost298                 karmen.franinovic@zhdk.ch   IAD Zurich University of the Arts
  Field Methods: Sound Postcards and Action Postcards




cost298                 karmen.franinovic@zhdk.ch   IAD Zurich University of the Arts
  Analytic: Describing Sounds and Actions
   Artefact : eg. bottle / glass / pen
   Function: eg. containing liquid / drinking / writing
   Context
   - Location: Where in the city? What is the function of the space
   - Users : (what age, profession, nationality (tourists?)...)
   Action:
   - Temporal Analysis of the Process
   - Action Type : pouring, hitting, pushing, cutting, stretching, blowing, shaking, rolling, sticking ..
   - Force : human, small, fast ...
   - Artefact Manipulation : how is the object handled?
   - Configuration : shape, size, structure, support, weight ...
   - Surface properties: smooth, cold
   Sound
   - Loudness, brightness, roughness (not related to material), timber, volume, pitch ...
   - Source: aerodynamics sounds, liquid sounds, vibrating solids, fire sounds
   - Material : elasticity, density...
   - Configuration : shape, size, structure (ex. resonatig cavities), support, weight ...
   - Rhythm : rhythm of vibration, repetition of sound events (eg. bouncing)
   - Aspects of space : delay (reverb, echo), dampening, perspective, distance, resonance...
   - Relation to the soundscape. Is the studied sound event localized in space or distributed?
cost298                               karmen.franinovic@zhdk.ch                IAD Zurich University of the Arts
  Analytic: Describing Sounds and Actions




cost298                 karmen.franinovic@zhdk.ch   IAD Zurich University of the Arts
  Analytic / Creation Methods: Sonic Playtable




cost298                  karmen.franinovic@zhdk.ch   IAD Zurich University of the Arts
  Analytic / Creation Methods: Sonic Playtable




cost298                  karmen.franinovic@zhdk.ch   IAD Zurich University of the Arts
  Analytic / Creation Methods: Sonic Playtable




cost298                  karmen.franinovic@zhdk.ch   IAD Zurich University of the Arts
  Conceptualisation Methods: Design Speed Dating




Eric Paulos, Ken Anderson, Michele Chang, and Anthony Burke, “Metapolis and urban life,” Proceedings of the 2005
conference on Ubiquitous Computing, 2005. karmen.franinovic@zhdk.ch
cost298                                                                                      IAD Zurich University of the Arts
  Conceptualisation Methods: Design Matrix




cost298                 karmen.franinovic@zhdk.ch   IAD Zurich University of the Arts
  Conceptualisation Methods: Design Speed Dating




cost298                 karmen.franinovic@zhdk.ch   IAD Zurich University of the Arts
  Conceptualisation Methods: Design Speed Dating




cost298                 karmen.franinovic@zhdk.ch   IAD Zurich University of the Arts
  With Objects!

   Actions and Location Matrix
   + Real Objects

   Concept for an interactive sounding artefact




cost298                             karmen.franinovic@zhdk.ch   IAD Zurich University of the Arts
  Conceptualisation Methods: Design Speed Dating




cost298                 karmen.franinovic@zhdk.ch   IAD Zurich University of the Arts
  Conceptualisation Methods: Design Speed Dating




cost298                 karmen.franinovic@zhdk.ch   IAD Zurich University of the Arts
  Experience Prototyping: Bodystroming and relabelling




Antti Oulasvirta, Esko Kurvinen, and Tomi Kankainen, “Understanding contexts by being there: case studies in bodystorming,”
Personal Ubiquitous Comput., vol. 7, no. 2, pp. 125–134, 2003.
P. Djajadiningrat, W.W. Gaver, and J.W. Frens, “Interaction relabelling and extreme characters: Methods for exploring
aesthetic interactions,” in Proc. of Designing Interactive Systems, Brooklyn, New York., 2000.
cost298                                      karmen.franinovic@zhdk.ch                       IAD Zurich University of the Arts
  Experience Prototyping: Sketching with Objects and Voice




cost298                  karmen.franinovic@zhdk.ch   IAD Zurich University of the Arts
  Experience Prototyping: Sketching with Objects and Voice




cost298                  karmen.franinovic@zhdk.ch   IAD Zurich University of the Arts
  Experience Prototyping: Stories without Words




cost298                  karmen.franinovic@zhdk.ch   IAD Zurich University of the Arts
  Experience Prototyping: Stories without Words




cost298                  karmen.franinovic@zhdk.ch   IAD Zurich University of the Arts
   Experience Prototyping: Video Scenarios
   Sonic Fishing




cost298                  karmen.franinovic@zhdk.ch   IAD Zurich University of the Arts
   Experience Prototyping: Video Scenarios




cost298                  karmen.franinovic@zhdk.ch   IAD Zurich University of the Arts
  Development Methods




cost298                 karmen.franinovic@zhdk.ch   IAD Zurich University of the Arts
  Development Methods




cost298                 karmen.franinovic@zhdk.ch   IAD Zurich University of the Arts
  Development Methods

          Dining Table aka Gamelunch, Stefano Delle Monache, Stefano Fumagalli and Simone Lüling. ZHdK workshop.




cost298                                     karmen.franinovic@zhdk.ch                    IAD Zurich University of the Arts
  Overview




   1. The Third Space of Sonic Interaction Design

   2. Methods for Interdisciplinary SID Workshops

   3. Conclusions




cost298                            karmen.franinovic@zhdk.ch   IAD Zurich University of the Arts
  Conclusions: What Didn’t Work?

      Working on Preconceived Ideas
      Developing Functional Prototypes




cost298                            karmen.franinovic@zhdk.ch   IAD Zurich University of the Arts
  Conclusions: What Worked?

      Play
         to relax and forget about what you know




cost298                            karmen.franinovic@zhdk.ch   IAD Zurich University of the Arts
  Methods for SID Development

      Play
         to relax and forget about what you know
         to imagine and to explore future scenarios




cost298                             karmen.franinovic@zhdk.ch   IAD Zurich University of the Arts
  Methods for SID Development

      Play
         to relax and forget about what you know
         to imagine and to explore future scenarios

      Sound and Touch Experiences
         to personally explore tangible multisensory experience




cost298                             karmen.franinovic@zhdk.ch     IAD Zurich University of the Arts
  Methods for SID Development

      Play
         to relax and forget about what you know
         to imagine and to explore future scenarios

      Sound and Touch Experiences
         to personally explore tangible multisensory experience
         to raise awareness of the context




cost298                             karmen.franinovic@zhdk.ch     IAD Zurich University of the Arts
  Methods for SID Development

      Play
         to relax and forget about what you know
         to imagine and to explore future scenarios

      Sound and Touch Experiences
         to explore personally tangible multisensory experience
         to raise awareness of the context

      Use of Voice and Objects
         to describe and communicate sounds
         to fake interaction in experience prototyping




cost298                              karmen.franinovic@zhdk.ch    IAD Zurich University of the Arts
 Thank you!




Acknowledgments:
COST Action on Sonic Interaction Design
Interaction Design Department, DD, ZHDK
Closed project of FP6-NEST-Path Measuring the Impossible

Thanks to the workshop co-organisers: Yon Visell, Lalya Gaye, Frauke Behrendt,
Daniel Hug, and the CLOSED project colleagues, as well as to the workshop
participants.