GCC_UsabilityEvaluation_McDonald by panniuniu

VIEWS: 2 PAGES: 16

									Melissa McDonald
LBSC 690- Spring 2011
Usability Assessment
Point Value: 30 Points
Date Due: February 15th

Complete the Usability Test Preparation form and then conduct three user tests for intuitiveness using scripted tasks. Record the task
completion time and notes. Consolidate your observations into final results using the format below.

Upload the completed Word file and link it to your page before midnight on February 15th.

Grading
10 Points: Form Completion: Are the answers well developed and appropriate?
10 Points: Notes: Did you capture the task completion time, user comments, and user actions?
10 Points: Result Write Up: Did the results relate to the notes? Did you rank the results and tie them to heuristics? Did you include positive
results? Did you recommend solutions?


User Test Preparation
Note: We will be testing intuitiveness, so please avoid sites that require long term use.

What site are you testing? I am testing Gaithersburg Camera Club
( http://sites.google.com/site/gaithersburgcameraclub/ )

What is the site's purpose? The site’s stated purpose, or mission, is to help camera enthusiasts become better photographers.

Who is/are the target user group(s)? Camera and photography enthusiasts are the target user group.

What three tasks will you be asking each user to complete? Please note what path you expect them to follow to complete it.
(Example Path for logging into TerpConnect - Click File Manager, Click Access My Files, Enter User Name and Password)




Melissa McDonald: Usability Assessment GCC                                                                                               Page 1
First Task:
Since the web address is very long, “ Google” Gaithersburg Camera Club, find out about GCC, when and where meetings are held, what
one can expect at a meeting, and how to join the club.
My expectations:
     Click on the Navigation sidebar link “About Us”
     Read through the information on this page (and if they notice the hyperlinks, they may come back to this page to locate answer to
        third task)
     Return to Navigation sidebar link and click on “Join the Club”

Second Task:
Find a book about Willa Cather in the club’s Lending Library and find out how to borrow it.
My expectations:
    Click on the Navigation sidebar link “Learning Center”
    Click on “Lending Library” and scroll through the bibliography until the book is found (I do expect some participants to do a
       shortcut and “search this site” for Willa Cather – but this will give error message I did find out about the keyboard shortcut Ctrl-
       F: “Your search for willa cather did not match any pages” – I did find out about the keyboard shortcut Ctrl-F, and two of my three
       participants used this when the “search this site” did not work.

Third Task:
Find out how to enter an image in the monthly competitions, what the submission rules are, and view winning entries.
My expectations:
           Click on Navigation sidebar link “Competition”
           In Contents box, click on “About Official Club Competitions” and then click on “Competition Rules”
           Scroll back up the page until the “View Winning Entries” link is located and click on it.




Melissa McDonald: Usability Assessment GCC                                                                                          Page 2
Adjust the following script to fit the web site you are testing and your personal style:

      Hello, I am conducting this user test to complete a class assignment and learn more about usability testing.

      Usability testing is a way of examining a web site in order to understand how intuitive the interface is and how to improve it. Your
       participation is critical for this evaluation. Please remember, we will be testing out the interface. We are not testing you.

      This (point to web site which should be on screen) is the website we will be testing.

      I'm going to hand you a task that I'd like you to try to complete. Please begin by reading the task aloud. Then describe to me what you
       are doing to try to complete the task. This lets me understand what you are thinking. Please tell me anything that comes to mind such
       as if you are looking for a particular word or icon or if something surprises you. I may prompt you if you are silent for a while.

      When you have completed a task, please let me know that you have completed it and hand me back the task card. I will then give you
       the next task card. We will test two tasks.

      Again, this gives us a chance to test the interface to see how intuitive it is. I appreciate your participation.

      Do you have any questions before we begin?




Melissa McDonald: Usability Assessment GCC                                                                                             Page 3
Participant 1: Katy

Task 1 Description: “ Google” Gaithersburg Camera Club, find out about GCC, when and where meetings are held, what one can
expect at a meeting, and how to join the club.



Start Time:         End Time:            Completion Time: 1:21 minutes

Notes (taken by Andreea):

   1)   Googled and she found the site in seconds - it is the first entry that comes up
   2)   About Us: to find where/when club meets – two times a month/map to location (18 sec)
   3)   What to expect from a meeting? (19 sec)
   4)   How to join the club? (12 sec)
   5)   Back to home page…scrolled page, did not find right away.
   6)   Clicked on “Member Forum” first and scrolled page
   7)   Returned to home page, with hint, went up two to find “Join the Club” (72 sec)
                   i. Scrolled down through page and back up to find “How to Join the Club” (12 sec)


Task 2 Description: Find a book about Willa Cather in the club’s Lending Library and find out how to borrow it.


Start Time:         End Time:            Completion Time: 1:90 minutes

Notes:
   1) Skimmed Home page, “Not seeing link to the book”
   2) Found Learning Library on Wheels in Navigation sidebar, scrolled though page
   3) She found instructions to find the book before book
   4) Does search (keyboard shortcut CTRL-F) on page to find Willa Cather




Melissa McDonald: Usability Assessment GCC                                                                               Page 4
Task 3 Description: Find out how to enter an image in the monthly competitions, what the submission rules are, and view winning
entries.


Start Time:        End Time:             Completion Time: 1:15 minutes

Notes:
   1) Back to Home
   2) Clicked on “Competitions” in Navigation Sidebar
   3) Found “Competition Rules” and link to download pdf version
   4) Scrolled down and found link for “Entry Form for Monthly Print Competition”
         a. I had to ask her to find second way:
   5) Found instructions on how to preregister an entry




Melissa McDonald: Usability Assessment GCC                                                                                    Page 5
Participant 2: Matthew

Task 1 Description: “ Google” Gaithersburg Camera Club, find out about GCC, when and where meetings are held, what one can
expect at a meeting, and how to join the club.

Start Time:         End Time:            Completion Time: 4:04:86 minutes

Notes:
   1) First went to “About Us”, but I told him that this wasn’t the page I wanted him to read and to check the navigation sidebar
       again.
   2) Back to “Join the Club”
   3) Scrolled down through and read off the items I wanted him to find
   4) Scrolled back up
   5) Kept reading and scrolling through left side of page to find “How to Join” but still did not see it……
   6) I directed his attention to the top right side of the page and then he found it.

He suggested that the How to Join section should be framed by a box, or highlighted in some other way. The left side of the page
dominates the user’s attention because the text is so dense.


Task 2 Description: Find a book about Willa Cather in the club’s Lending Library and find out how to borrow it.

Start Time:         End Time:            Completion Time: 2:38.12 minutes

Notes:
   1) Matt: “Learning Center?” Me: “Yes”
   2) Contents box: “Library on Wheels” and scrolled through the page
   3) “Okay if I do this?” [used shortcut, Ctrl F] “Yes”
   4) Found book in the list quickly afterward using the keyboard shortcut



Task 3 Description: Find out how to enter an image in the monthly competitions, what the submission rules are, and view winning
entries.

Melissa McDonald: Usability Assessment GCC                                                                                    Page 6
Start Time:        End Time:            Completion Time: 3:02:15 minutes

Notes:
   1) He went back to navigation sidebar
   2) Clicked on “About us”
   3) Scrolled down through page and back up
   4) Back to Navigation Bar
   5) Clicked on Competitions, scrolled down to find digital and print information
   6) Scrolled back up and found the winning entries hyperlink on the right




Melissa McDonald: Usability Assessment GCC                                           Page 7
Participant 3: Alexander

Task 1 Description: Find out about Gaithersburg Camera Club (GCC), when and where meetings are held, what one can expect at a
meeting, and how to join the club.

Start Time:         End Time:            Completion Time: 3:32.20

Notes:
   1) “Googled” Gaithersburg Camera Club – “clicked on first site that was listed”
   2) “Looking for when meetings are held”
   3) Alexander looked at calendar first and found next meeting dates
   4) This was not all of the information I had asked him to search for, so I gave him a hint “not found on Home Page”.
   5) He clicked on “About Us”
   6) Scrolled down through the page and found the meeting information
   7) Scrolled up to top, looking for Join the Club information
   8) Gave him hint “It is on the right side of the page”
   9) He found it instantly, and read the information to me.


Task 2 Description: Find a book about Willa Cather in the club’s Lending Library and find out how to borrow it.

Start Time:         End Time:            Completion Time: 3:16.56

Notes:
   1) Searched home page on navigation sidebar
   2) Clicked on “Learning Center”
   3) Scrolled down through the pages of the bibliography
   4) I told him “It is not easy to find”
   5) Tried searching Willa Cather via search bar – no results
   6) Tried searching “Books” via search bar – gave him list of the club’s newsletters
   7) I gave him a hint (“Use shortcut”, but being a teenager, he ignored me)
   8) Clicked on “Site map” on navigation sidebar - scrolled, nothing there
   9) I gave him another hint “Use keyboard shortcut” -- my son finally put aside his attitude and did that shortcut and instantly
       found the name

Melissa McDonald: Usability Assessment GCC                                                                                   Page 8
He suggested that the books should be added to the “search” bar for easier use of the Lending Library.


Task 3 Description: Find out how to enter an image in the monthly competitions, what the submission rules are, and view winning
entries.

Start Time:        End Time:             Completion Time: 5:03.24

Notes:
   1) Clicked on competition in Navigation Sidebar
   2) Searched Contents and clicked on Competition Rules
   3) “Scrolling down to find how to enter”
   4) Scrolled up and down to find print and digital rules
   5) Scrolled up and “on right view latest winners on right side of screen”




Name                     Time Task #1             Time Task #2             Time Task#3
Katy                     1:21                     1:90                     1:15
Matthew                  4:04:86                  2:38.12                  3:02:15
Alexander                3:32.20                  3:16.56                  5:03.24


Additional notes about my testers:
Katy’s time was considerably shorter for a few reasons:
In class, we were rushing to get through the practice run, and wanted to have our tester try all three tasks. We did not read the
questions aloud. She very quickly skimmed the text to find the answers. Matthew and Alexander spent more time reading aloud the
questions and reading aloud the answers. Lastly, my technology savvy son, Alexander, was not a particularly willing participant (as
he would rather have been texting/IMing/FBing his girlfriend instead of helping mom) and his attitude prevented him from
performing the tasks at a quicker pace.

Melissa McDonald: Usability Assessment GCC                                                                                    Page 9
Results

What positive attributes of the website did you identify? Club members’ photography images are well represented on the site. A
selection of images is placed in a slide show format in the center of home page, and the Navigation sidebar has hyperlinks to several
members’ photo gallery websites. There is a special note about the calendar (“should it not be visible”), and ways to correct the problem if it
is not visible. The calendar is up-to-date with timely events. The GCC Forum is a nice feature and a way that members can share
information.


What problems did participants encounter when using the website?
Note: Describe each problem and tie it to a heuristic. Then rank problems Major, Medium, or Minor and include at least 1 potential solution.
You can use the table below or another format.

Description                                          Heuristic                       Ranking             Possible Solution
Hyperlink to Membership Application is not the       Match between system and the    Minor               “Join the Club” information needs to
main focus of the “Join the Club” link from          real world                                          be highlighted or framed by a box.
home page; Left side of screen is dense with
text so it keeps your attention focused there; not
much on right side to bring one’s attention to
the “Join the Club”
Hyperlink to Membership Application in odd           Match between system and the    Minor               See above, or possibly placed above
location on page (from the Contents box, one         real world                                          the dense text.
would expect to see it below the Introduction &
Monthly Meetings).
Book titles are not included in the search bar; if   Error prevention                Minor               Books should be included in the
one did not know the keyboard shortcuts, it                                                              search bar for easier location of a
would be very hard to find a particular book                                                             particular title.
title.
Digital and Print rules hard to read in present      Match between system and the    Minor               Place digital and print rules side by
format.                                              real world                                          side in a table
Search error message to vague.                       Aesthetics and minimalist       Minor               Could suggest using the keyboard
                                                     design                                              shortcut as a search option




Melissa McDonald: Usability Assessment GCC                                                                                             Page 10
Gaithersburg Camera Club home page is first on the list.




Melissa McDonald: Usability Assessment GCC                                                                         Page 11


                                                           Screen capture did not hold the calendar information.
The calendar did not hold the dates when I captured the screen.




Melissa McDonald: Usability Assessment GCC                        Page 12
How to Join the Club is overlooked because the text dominates the left-side of the page. Given the order of the Contents list, one would
assume that the How to Join the Club would be below the Introduction and Monthly Meetings.




Melissa McDonald: Usability Assessment GCC                                                                                          Page 13
Competitions page is very long…. Detailed list of rules for entering print entries follows that of digital entries.




Melissa McDonald: Usability Assessment GCC                                                                            Page 14
Melissa McDonald: Usability Assessment GCC   Page 15
Melissa McDonald: Usability Assessment GCC   Page 16

								
To top