presentation Notes slide Rally

Document Sample
presentation Notes slide Rally Powered By Docstoc
Usability Analysis Visualization to Improve Communication
and Trust

Rally Pagulayan
Usability & User Interface Design, Oracle Corp.

       A step by step description of this analysis method and how it helps
        overcomes the reluctance of development teams to implement usability
        evaluation results

                                                                     slide 1 of 22
Convincing development to implement findings from
usability testing

Why is it a challenge?
    We don’t deliver test findings quickly enough.
    We don’t communicate the findings effectively
    Development teams doubt the credibility of our findings

                                                               slide 2 of 22
Our Approach
Visualizing analysis with affinity diagramming
    Delivers results faster
    More effectively communicates key usability findings
    Helps to build credibility and trust

    Describe methodology
    Discuss benefits

                                                            slide 3 of 22
Methodology Overview
 Before usability test
 Analysis during first two - three participants
 Analysis after three participants
 Completing analysis
 Presenting findings

                                                   slide 4 of 22
Before Usability Test
 Location of analysis
    Central and visible
    Large

 Make team aware of the analysis
    Post key issues
    Tell team to look

                                    slide 5 of 22
First Three Participants
After the first participant session, transcribe
every observation onto a Post-It note

                                                  slide 6 of 22
First Three Participants, cont.
Impose Groupings
      Specific groupings not critical

Repeat after each participant

No real constraints

                                         slide 7 of 22
After two participants…
                           Early groupings
                           Some not grouped
                           No real ordering
                           No other spatial
                           Minimal labeling

                                     slide 8 of 22
After Three Participants
Apply vertical and horizontal logic

      Vertical = identical issues

      Horizontal = related issues

      Add labeling

                                      slide 9 of 22
 Vertical groups
 Horizontal group
 Labeling

                     slide 10 of 22
Completing the analysis
   Repeat after each participant

   Add to groups, build new groups,
    readjust groupings, create sub-

   Use additional visual information to
    imply relationships
        Spatial placement, outlines, labeling

                                                 slide 11 of 22

           HGrid issue (original)
           Initial actions
           Moving to Selected Items
           Selected Items control problems
           Stuck on first page

           Problems on initial exposure

                                       slide 12 of 22
Example, cont.

                 slide 13 of 22
Presenting the Findings
Present the affinity diagram

                               slide 14 of 22
Presenting the Findings
Most space = biggest issues

                              slide 15 of 22
Presenting the Findings
Long vertical columns to highlight repeated events

                                                     slide 16 of 22
Presenting the Findings
Horizontal sets show problem manifested in various ways

                                                  slide 17 of 22
Presenting the Findings
Spatial relationships lend themselves to presentation flow

                                                     slide 18 of 22
Discussion of Benefits
Time savings

Improved analysis
    Forced to consider all data
    Encourages reinterpretation, refinement

Improved effectiveness of communicating results

Improved credibility and trust

                                                  slide 19 of 22
Improved Communication
Audience understands quickly
    Visualized results are tangible
    Implies relationships and severity

Focuses attention on big picture

Audience less skeptical
      Preemptively answers:
         Did that really happen?
         Is that really a problem? (question severity)
         Is that really a valid conclusion (question logic)

                                                               slide 20 of 22
Credibility and Trust
Usability analysis is a ‘black box’
      Encourages negative perceptions

Removes mystery of analysis
    See logic
    See complexity and volume of data, skills and effort

Akin to showing our secrets

                                                            slide 21 of 22


                   slide 22 of 22

Shared By:
Description: presentation Notes slide Rally