hci

Document Sample
hci Powered By Docstoc
					Human Computer Interaction Project



RSS Online News
Paper
Project Phase – 2 Documentation




Fayzan ul Haque, Taha Rafiq, Farrukh Ahmed, Tabish Ahmed Syed
11/29/2010
Table of Contents
Evaluation method ........................................................................................................................................ 3
   Heuristic Evaluation .................................................................................................................................. 3
   Reasoning of Rating .................................................................................................................................. 7
   Evaluation Checklist .................................................................................................................................. 3
Survey Forms................................................................................................................................................. 5
Evaluation of design ..................................................................................... Error! Bookmark not defined.6
   Heuristic Evaluation ................................................................................. Error! Bookmark not defined.6
   Reasoning of Rating ................................................................................. Error! Bookmark not defined.6
Issues defined within design evaluation ....................................................................................................... 7
Usability Metrics ......................................................................................................................................... 12
Evaluation methods
Heuristic Evaluation
The first technique we have used is heuristic evaluation. The new evaluation has changed a bit since the
last version due to the better understanding of the design issues we identified earlier. This along with
more research and development time caused further improvement in both Project and its evaluation
score.

We're using Jakob Nielsen's 10 heuristics for Heuristic Evaluation. Evaluation marks are out of 5. The
results are given in the ‘Evaluation Results’ section.

Evaluation Checklist
Evaluation Checklist was used after the designing phase in order to check whether each page has been
created in accordance to the usability criterions. Hence we created the following criterions and
questions which we are as follows:

Checklist:


    1.   Are there presented with:
                                                                                         Yes       No
    a.   An explanation as how to use this Website
    b.   A series of illustration in a menu format
    c.   Navigational hints about finding your way through the website

    2.   What level of interaction is required to move through the
         Website

    These ratings are from High Interaction to Minimal Interaction.      Pick One:   5     4   3   2     1

    3.   From your current screen can you
                                                                                         Yes       No
    a.   go to next page
    b.   go back to the beginning
    c.   refer to another section
    d.   go back to previous page
    e.   edit some sections

    4.   How much information is presented on each page of the Website
         At one time?

    These ratings are from Too much to Too little.                       Pick One:   5     4   3   2     1

    5.   How clear is the on screen presentation of the Website?

     These ratings are from very clear to difficult to see.              Pick One:   5     4   3   2     1
    6.   As you worked your way through the section did you feel that
                                                                                           Yes   No
    a.   The information was been related to your existed knowledge
    b.   Your interest is maintained throughout the navigation of the website.
    c.   Categories and data were arranged in a way that they facilitated your expansion
         of knowledge




Cooperative evaluation
 As the main focus of our project is for the users to use our project extensively for news reading, hence
we have integrated the users input while evaluation of our project. For this we have used “Cooperative
evaluation", in which the user is encouraged to see himself as a collaborator in the evaluation rather
than just a subject. In this both the user and the evaluator have extensive communication collaboration,
i.e. Query and feedback is done by both the user and evaluator.

Advantages:

o   It is less constrained and therefore easier for the evaluator, who is not forced to sit in solemn
    silence;
o   The user is encouraged to actively criticize the system rather than simply suffer it;
o   The evaluator can clarify points of confusion so maximizing the effectiveness of the approach. Note
    that it is often not the designer who is the evaluator, but an independent person.

Practical Implementation of Cooperative Evaluation
The following steps were taken for Cooperative Evaluation:

o   Take it in turns to be an evaluator (of your own system) and a user (of another system - preferably a
    different topic).
o    As an evaluator spend a few minutes thinking of some scenarios and tasks for the user to perform.
    Include some complex tasks as well as some simple ones.
o    Decide on whether you are going to use think-aloud or cooperative evaluation.
o   Then run the evaluation, keeping full notes of the users actions and behavior and any problems.
o   The fuller the detail in the protocol, the better.
Survey Forms
The following survey format below is the form we used for the survey of our application.

The RSS Insider Survey

Note: Please fill all the questions.

1) How likely are you to return to the website?
   a) Very likely
   b) Somewhat likely
   c) Somewhat unlikely
   d) Not at all likely

2) What features had influenced your decision to continue using this website?
   a) Magazine view
   b) Categorization
   c) Content selection

3) Was it easy to find the type of news you were looking for?
   a) Yes
   b) No

4) Was navigation and layout better enough for you to understand how to use the website
   a) Yes
   b) Somewhat Yes
   c) Somewhat No
   d) No

5) Did you like the new way of showing news i.e. the layout of the Website? (Please give one rating)
   a) 5 – The best in the world
   b) 4
   c) 3
   d) 2
   e) 1 – The worst in the world

6) Did Category method really helped you in categorization and sorting of news?
   a) Yes
   b) Close enough
   c) Not so sure
   d) No way in hell
7) What are the main reasons for using our website?
   a) Keep updated with the news
   b) For show off, i.e. this site looks way better than others
   c) to read specific category news
   d) Easy to use news reading

8) How would you rate the website overall
   a) Excellent
   b) Very good
   c) Good
   d) Average
   e) Poor

9) Please rate the following aspects of this website

       Aspects                                          5         4       3         2          1
       Design
       Content/Information
       Ease of Navigation
       Speed/Download time
       Up-to-date ?
       Overall Impression


10) Have you always found the desired updated news in the same category as it was supposed to be
    a) Always
    b) Sometimes
    c) Few occurrences
    d) Never

11) Will you use this website in the future?
    a) Yes, always
    b) Often
    c) Sometimes, when needed
    d) Never
Evaluation Results
Heuristic Evaluation

Heuristic                              Evaluator 1        Evaluator 2     Evaluator 3          Evaluator 4
Visibility of System Status            3                  4               3                    3
Match between system and the           5                  4               5                    5
real world
User control and freedom               3                  4               4                    2
Consistency and standards              4                  5               5                    5
Error prevention                       0                  1               2                    0
Recognition rather than recall         5                  4               5                    5
Flexibility and efficiency of use      2                  3               2                    3
Aesthetic and minimalist design        5                  5               5                    4
Help users recognize, diagnose,        0                  0               0                    0
and recover from errors
Help and documentation                 1                  1               1                    1


Reasoning of Rating


Visibility of system status

       Loading indicators are missing

Match between system and the real world

       Very good, as the interface presented is natural in the form of a newspaper

User control and freedom

       Undo functionality is missing
       Ability to go to previous, next page is present

Consistency and standards

       Standard newspaper conventions are followed
       However, there is a slight discrepancy in the categories page, with the theme and UI
Error prevention

        Hasn't been designed yet

Recognition rather than recall

        Built well, as the user can recognize newspaper interface easily

Flexibility and efficiency of use

        Keyboard shortcut support is missing

Aesthetic and minimalist design

        Design is minimalistic and easy on the eyes

Help users recognize, diagnose, and recover from errors

        Hasn't been designed yet

Help and documentation

        Documentation and help is minimal as of yet

Evaluation Checklist



    7.   Are there presented with:
                                                                                         Yes       No
    d.   An explanation as how to use this Website
    e.   A series of illustration in a menu format
    f.   Navigational hints about finding your way through the website

    8.   What level of interaction is required to move through the
         Website

    These ratings are from High Interaction to Minimal Interaction.      Pick One:   5     4   3   2    1

    9.   From your current screen can you
                                                                                         Yes       No
    f.   go to next page
    g.   go back to the beginning
    h.   refer to another section
    i.   go back to previous page
    j.   edit some sections

    10. How much information is presented on each page of the Website
        At one time?

    These ratings are from Too much to Too little.                       Pick One:   5     4   3   2    1
    11. How clear is the on screen presentation of the Website?

     These ratings are from very clear to difficult to see.                    Pick One:   5     4   3   2    1

    12. As you worked your way through the section did you feel that
                                                                                               Yes       No
    d.   The information presented is related to your existed knowledge
    e.   Your interest is maintained throughout the navigation of the website.
    f.   Categories and data were arranged in a way that they facilitated your expansion
         of knowledge




Cooperative Evaluation
The results of the cooperative evaluation have been incorporated into design issues section.

Survey Forms


The survey was carried out with 10 users. The results are given below.

Question                                                       Frequency of Answers
How likely are you to return to the website?                   Very likely – 7
                                                               Somewhat likely – 3
What features had influenced your decision to                  Magazine view – 1
continue using this website?                                   Categorization – 4
                                                               Content Selection – 5
Was it easy to find the type of news you were                  Yes – 4
looking for?                                                   No – 6
Was navigation and layout better enough for you                Somewhat Yes – 5
to understand how to use the website                           Somewhat No – 5
How much you like the new way of showing news                  Four – 5
i.e. the layout of the Website?                                Three – 3
                                                               Two – 2
Did category method really helped you in                       Yes – 8
categorization and sorting of news?                            Not sure – 2
What are the main reasons for using our website?               Easy to use news reading - 5
                                                               To read specific category news – 5
How would you rate the website overall?                        Very Good – 2
                                                               Good – 5
                                                               Average- 3
Have you always found the desired updated news                 Always – 6
in the same category as it was supposed to be?                 Sometimes – 4
Will you use this website in the future?                       Often – 5
                                                               Sometimes when needed – 5
Aspects               5   4   3   2   1
Design                    6   3   1
Content/Information   2   5   3
Ease of Navigation    6   3   1
Speed                         4   4   2
Up-to-date ?          8   2
Overall Impression    1   4   5
Issues defined within design evaluation
The following explains the issues which are currently there in relationship to the evaluation of the
project design


S.No                                              Design Issues
  1  Help and documentation is missing

 2     Error prevention and recovery mechanisms need to be developed further

 3     Layouts need to be made consistent

 4     Loading indicators are required to keep user notified of system status

 5     Clicking on news takes user to external page- can lead to loss of context and familiarity

 6     Predictability is affected as on home page- the entire category needs to be made a link instead of
       only title

 7     Task Migratability is low, user can not import feeds from popular readers such as Google Reader

 8     Page navigation is difficult to spot
Usability Metrics
     Our planned levels for the Usability Metrics are-

Effectiveness                                            90
Efficiency                                               80
Satisfaction                                             90


                                                                            RSS Online newspaper
S. No.          Objective
                                                               Efficiency            Effectiveness        Satisfaction


1               Predictability              10 %          8                     9                    9


2               Short Term Memory           10 %          10                    10                   10


3               Consistency                 10 %          7                     8                    6


4               Customizability             10 %          5                     5                    6


5               Task Migratability          10 %          3                     3                    3


6               Substituitivity             10 %          4                     6                    4


7               Observability               10 %          7                     6                    6


8               Recoverability              10 %          9                     9                    9


9               Task Conformance            20 %          18                    18                   18


                Overall User Rating         100 %         71                    74                   74
Re-design Rationale
S.No Design Issues                                        Re-design Rationale
  1  Help and documentation is missing                    A brief introduction to the service will be
                                                          given initially, and the UI will be explained in
                                                          it. It can also be accessed later via help.
 2    Error prevention and recovery mechanisms need       Error response framework will be developed
      to be developed further                             to show errors in the form of popup status
                                                          messages.
 3    Layouts need to be made consistent                  Home page UI needs to be made vertically
                                                          oriented to solve this problem.
 4    Users aren’t notified of system status              During loading, indicators need to be shown.

 5    Clicking on news takes user to external page-       News stories will be loaded in modal popup
      can lead to loss of context and familiarity         windows.

 6    Predictability is affected as on home page- links   The whole category will be made a single link.
      are difficult to detect.
 7    Task Migratability is low, user can automatically   A ‘suggest’ feature will be used to allow users
      add feeds                                           to automatically add feeds for a category.
 8    Page navigation is difficult to spot                The previous and next page links will be given
                                                          together

				
DOCUMENT INFO
Shared By:
Categories:
Tags:
Stats:
views:14
posted:10/27/2011
language:English
pages:13