cofes2005 by HC111130005736

VIEWS: 0 PAGES: 27

									   novel visualization and
interaction for large displays

       mary czerwinski
      microsoft research
• Patrick
  Baudisch
• Mary         vibe team
  Czerwinski
• Brian
  Meyers
• George
  Robertson
• Greg Smith
• Daniel
  Robbins
• Desney
  Tan
• Nuria
  Oliver
large display surfaces are here




          Workstation in the real world
       home setup




Generic snapshot in real person’s bedroom
             overview

• initial large display research
  –prototypes around usability issues
   observed
• visualization and interaction
  –new user experiences have to scale
   the wide continuum of displays
• future directions
                            harris poll responses (7/02,
                                      N=1197)
                                     Mutiple PCs and Displays

                      80%
                      70%
Percent Respondants




                      60%
                      50%
                      40%                                                                    All
                      30%
                      20%
                      10%
                      0%
                              None   Multiple monitors     Laptop and    Dualmon or higher
                                       attached to       desktop monitor
                                          multiple         connected
                                       computers.           together.
                                                   Config
         why a larger display surface?

                                            Projected LCD Pricing 2002-2005

• productivity benefits         $1,200
                                            $1,089
  10-30% (despite sw            $1,000
                                                        $905
                                 $800                                              15" -13.5%
                                                                  $752
  usability issues)                         $699




                          $US
                                 $600                   $597                $625   17" -14.6%
                                                                  $510
                                            $437                            $436   18" -16.9%
• users prefer more
                                 $400                   $378
                                                                  $327      $283
                                 $200

  display surface                  $0
                                         2002        2003      2004      2005



• prices dropping fast
• footprints getting
  smaller
      1st prototype--dSharp display

• triple
  projection
• matrox
  parhelia card
• 3028 x764
  resolution
• 42 in. across
• slightly curved
• 120 degree
  FOV
                      task times – significant
                                    Effects of Display Size on Task Times


                              160
Average Task Time (Seconds)




                              140
                              120
                              100
                                                                            Small
                              80
                                                                            Large
                              60
                              40
                              20
                               0
                                                  DISPLAY
                user satisfaction - significant
                                  the tasks were easy to perform
Average Rating (1=Disagree,



                              5

                              4
         5=Agree)




                              3

                              2

                              1

                              0
                                       Small                       Large

                                                 Display Size
windows layout - significant
     I was satisfied with the ease of windows
                       layout

                 5
Average Rating
 (1=Disagree,


                 4
   5=Agree)


                 3                          Small
                 2                          Large
                 1
                 0
                     Display Size
but…usability issues
 • why click to bring a
   clearly visible window
   into focus? caused
   many errors
 • where is my cursor?
 • where is my start
   button?
 • where is my taskbar?
 • where are my dialogs?
 • the software doesn’t
   know where the
   bezel is…
   input: high density cursor
                                                  problem
                                                  • at high mouse speeds, the mouse cursor
   use                                              seems to jump from one position to the
mo ion
    t                                               next
 mo
 regular mouse cursor
                                                  solution
                                                  • high-density cursor inserts additional
                                 fill-              cursor images between actual cursor
  use                      rsors      i
mo ion         fi ll-in cu ame prev n curs          positions
                         t fr        ious ors
 mo
    t          curren                    fram     • the mouse cursor appear more continuous
                                              e
high-density cursor




the windows mouse trail…
• makes mouse trail last longer
• drawback: cursor images lag behind
                                                        Windows mouse trail
...is not high-density cursor
• hd cursor makes mouse trail denser
• lag-free: mouse stops => cursor stops
                                                        high-density cursor
                input: drag-and-pop
problem
• large displays create long distance
  mouse movement
• touch & pen input has problems moving
  between screen units

solution
• drag-and-pop brings proxies of targets
   to the user from across display surfaces
• the user can complete drag interactions
   locally—no need to deal with distances
   or to cross display borders
        vibelog: 2 research paths
• 1st activity repository for
  studying windows usage in
  aggregate
  – can profile users based on
    display size
  – can be extended to visualize
    workflow and capture context
• single user: capture task
  contexts to surface pertinent
  ui or provide reminders
    windows and task management
           issues emerge
• larger displays =
  more open windows                                                   Relationship between # of Monitors and # of
                                                                                  Windows Left Open
• multimon users                                              18.00
  arrange windows                                             16.00

  spatially
                                Avg. # of Windows Left Open
                                                              14.00


• taskbar does not
                                                              12.00
                                                                                                               Single Monitor
                                                              10.00
  scale:                                                       8.00
                                                                                                               DualMon
                                                                                                               TripleMon
  – aggregation model not                                      6.00

    task-based                                                 4.00

  – users can’t operate on                                     2.00

    groups of related windows                                  0.00
                                                                                  No. of Monitors
                                 changes in window access patterns
                                 100


                                 90


                                 80


                                 70
Percentage of Access Technique




                                 60


                                                                       Win
                                 50
                                                                       Taskbar


                                 40


                                 30


                                 20


                                 10


                                  0
                                       1              2            3
                                              Number of Monitors
   multitasking support

•vibelog
•projectbar, layoutbar,
 groupbar
•scalable fabric
   task management: groupbar

• taskbar for lightweight grouping of
  windows
• allows for multiple bars, spatial placement
  of bars
• ~400 internal downloads
• desktop snapshotting; task snapshots
• licensing to external companies
    task management: scalable fabric
•   configurable central focus + peripheral context
•   easy task switch from periphery to focus area
•   leverages human spatial memory
•   over 600 downloads, licensing externally
                       table cloth

• problem:
   – user wants to
     access content
     physically far
     away
• solution:
   – pan the desktop
     to user
   – compress
     content to the
     right of focus
   – grab content
     you need and
     snap back
          meeting support: wincuts
• microsoft supports:
  –   individual user productivity (eg. word, excel, …)
  –   disseminating information (eg. powerpoint, sharepoint, …)
  –   communication (eg. outlook, MSN messenger, …)
  –   distance collaboration (eg. Netmeeting, Livemeeting, …)
• but what about co-located collaborative work?
  – people bring different expertise and information on
    personal devices to meetings and need to share
       • today’s model is broken—only one person gets to display entire
         desktop at a time (for better or worse)
       • or, must share applications and files with others
           – what about private information?
• what about ui that should be scaled for the task at
  hand?
          scalable ui research

• datelens with Ben Bederson
• facetmap—visualizing your digital
  memories
    datelens with Ben Bederson
• fisheye
  representation of
  dates
• compact overviews
• user control over
  the view
• integrated search
  (keyword)
• enables overviews,
  fluid navigation to
  discover patterns
  and outliers
• integrated with
  outlook
                   facetmap
• a way to visualize all of your digital
  memories
  – soon, everything will be recorded
     • heart rate, blood oxygen levels, conversations,
       where you go, who you talk to, what you touch
       electronically, etc.
  – need ways to browse all these streams of
    media
     • most studying text lists of search results
     • can we do something purely visually that scales?
            future vibe directions
• novel interaction and visualization techniques
  that scale from small to very large displays
• continued evaluation and iteration of designs
  from a user-centered perspective
• more focus on collaboration and group
  awareness with large displays
• more information:
  http://research.microsoft.com/research/vibe
thank you!

								
To top