Addendum to the Usability Test Report for MetaLib
Document Sample


Addendum to the Usability Test Report for MetaLib: Comparison of Participant User Groups
After the scenario-based testing, participants were asked a series of questions to determine ease
of use and effectiveness of the MetaLib research portal. Faculty, graduate students and
undergraduate students showed only minimal differences in their perception of MetaLib, as
illustrated below. Each question was ranked 5 (positive response) to 1 (negative response).
How easy was it to use MetaLib? How easy was it to create your own
QuickSets?
3.8
3.7 4
Average Score
3.6
Average Score
faculty n=4 3
3.5 faculty n=4
grad n=6
3.4 2 grad n=6
undergrad n=5
3.3 undergrad n=5
1
3.2
3.1 0
5 (very easy) to 1 (difficult) 5 (very easy) to 1 (difficult)
How easy was it to use the My Space How easy was it to determine how many
feature? records were retrieved by searches you
conducted?
4
4.8
Average Score
3
Average Score
faculty n=4 4.6
faculty n=4
2 grad n=6 4.4
grad n=6
undergrad n=5 4.2
1 undergrad n=5
4
0 3.8
5 (very easy) to 1(difficult) 5 (very easy) to 1 (difficult)
How would you rate the option to create How easy was it to determine how
your own QuickSets? results were ranked?
5 5
Average Score
4 4
Average Score
faculty n=4
3 faculty n=4
grad n=6 3
2 grad n=6
undergrad n=5 2
1 undergrad n=5
0 1
0 0.5 1 1.5 0
5 (Useful) to 1 (Unnecessary) 5 (very easy) to 1 (difficult)
How easy was it to change the sort order How would you rate your overall
of the results? experience with MetaLib?
3.3 3.6
Average Score
3.2
Average Score
3.4 faculty n=4
3.1 faculty n=4
3.2 grad n=6
3 grad n=6
2.9 undergrad n=5
undergrad n=5
3
2.8
2.8
2.7
5 (excellent/satisfying) to 1
5 (very easy) to 1 (difficult) (poor/frustrating)
How likely are you to use this resource
Which areas did you find most difficult to
for online research? navigate:
faculty grad undergrad
3.9
n=4 n=6 n=5
QuickSearch 2
3.8
Average Score
faculty n=4
Find Database 1
3.7 Find E-Journal
grad n=6
3.6 MetaSearch 2 3 1
undergrad n=5
3.5 My Space 2 4 3
3.4 Individual Result/
5 (very likely) to 1 (unlikely)
Finding Full Text 1 3
Result Pages 1
Please indicate which areas could be improved
How likely are you to recommend this (provide more information if necessary):
resource to someone for online faculty grad undergrad
research? n=4 n=6 n=5
Site Design 2 2 2
4 Search Interface 1 1 1
Average Score
3 faculty n=4 Basic Search 1 1
2 grad n=6 Advanced Search 1
undergrad n=5 Site Navigation 3 3
1
Result Page Navigation 1 3
0
Content 1 1
5 (very likely) to 1 (unlikely)
Terminology 1 5 2
Result Pages 1 1 1
Page Loading/ Result
Response Time 1 1 1
Format Options 1
Other
Get documents about "