Usability Testing Report: DRAFT
PathFinder Pro in the Library Online Catalog
April 14, 2009
Testers: Debra Agnoli and Lucinda M. Hall
Purpose:
The User Assessment Group (UAG) tested a new feature available in the online
catalog called PathFinder Pro. PathFinder Pro is a group of links in a separate box that
can help students expand their searches. The box of links is subject specific when a
user is looking at single items. The links are more general with lists of resources.
Methodology:
We user tested 5 undergraduates in the class of 2012 and 1 staff member, using
the list of volunteers from the 2012 Library Open House.
Introduction:
We explained to each person tested that the Library added a new feature to the
catalog. We want to see if people noticed the new feature, if they have, if they used it or
not and provide them with some instruction about the new feature. We created 6 multi-
part questionnaire based on suggestions from the Library Catalog Advisory Committee
(LCAC).
Results:
As of April 10, 2009, we tested 5 undergraduate students from the class of 1012
and 1 staff member. Specific questions and answers are listed in the Appendix. One
tester has used the Expand Your Search box. The other testers did not notice the
Expand Your Search box and have not used the new features in it. However, when
prompted to use the various links, they all loved it and would use it for their research.
Recommendations:
1. Make the box more visible. Several of the students did not see the box right
away.
2. Leave out Amazon.com or put it at the very end of the list. The students said they
would not use that link.
3. Put the “Cite this Item” first and change its name to “How to Cite This Item.”
This seemed the most useful and valuable link.
4. Put explanatory text for the Book Review Digest Plus link. Most students do not
realize how valuable book reviews can be.
PathFinder Pro User Testing Report Page 1
5. You might consider leaving just the simple Search360 link and show the other
databases under the Additional Searches button. They perform the same
searches and the additional links take up real estate.
Here is a summary of the results for each question:
1) a. What does the term Expand Your Search mean to you?
They will find more items for their particular search.
b. What does the term Additional Searches mean to you?
They will find more resources perhaps outside of the Dartmouth College
Library.
2) a. How often do you use the links under Expand Your Search and/or the
Additional Searches button?
1 student used it frequently. Another student used it for a term paper. The
other 4 testers never used.
b. What would you expect to find when clicking on the links under Expand Your
Search?
There were a variety of answers to this question. Some expected to go to
Amazon.com and buy the book, others expected to find the book at other
libraries, while other responses including finding articles related to the search or
search WorldCat.
3) a. What would you expect to find when clicking on the Additional Searches
button?
Most of the testers expected to find more resources for Mark Twain. One
tester thought they would find Search360. Another thought they would find other
searches for the book.
b. If you haven’t used the links under Expand Your Search and/or the
Additional Searches button in the past would you consider using them now?
All the testers were very enthusiastic about using this new feature
including the tester who already used it.
PathFinder Pro User Testing Report Page 2
4) Does the order of the links and button under Expand Your Search matter to
you?
Three testers said the other did not matter to them but felt the box did not
stand out. Two testers felt the more academic links such as Cite This Item or
the links to databases needed to be first. Two testers questions why
Amazon.com was there at all.
5) a. Have you ever used the Book Review Digest Plus link?
All 6 testers said no.
b. If so, were you satisfied with the results you found?
No applicable responses.
6) Now that you are familiar with the resources available in the Expand Your Search
do you think that you would prefer or use any of these items more than the others?
Several of the testers said they would use Cite This Item and the Book
Review Digest Plus specifically. Another tester said they would use WorldCat
and Academic Search Premier more. They all planned to use it.
PathFinder Pro User Testing Report Page 3
Appendix 1 – Combined responses to each question
1) a. What does the term "Expand Your Search" mean to you?
o Finding books on other web sites
o Finding more specifics about the book – pub date and other related info
o A wider search
o Search more specific book on the subject or author
o Other book written by Mark Twain
o Not sure what World Cat is, I guess I would go to Amazon if I wanted to
buy the item
b. What does the term "Additional Searches" mean to you?
o Searching outside of Dartmouth College
o Additional information on related material from the original search
o Collections of research on the topic
o (Couldn’t find it a first) Additional information of the original search
o Something else about Mark Twain within the category
o Similar searches
2) a. How often do you use the links under “Expand Your Search” and/or the
“Additional Searches” button?
o 1 - Use frequently
o 2 – I don’t
o Use Cite this for end of the term research paper
o 2 -- Never
b. What would you expect to find when clicking on the links under “Expand Your
Search”?
o Other libraries that have the book
o 2 -- Purchase the book through Amazon
o Other related books
o Other sources and references
o 3 -- Cite this item is great and a very helpful resource
o Used World Cat to see other library
o More on the book
o Looked for article in Lit and Lang
PathFinder Pro User Testing Report Page 4
3) a. What would you expect to find when clicking on the “Additional
Searches” button?
o Search 360
o Other databases or search engines
o More specific articles to Mark Twain
o Other search for this book (Clicked on button and saw reviews and
articles—Oh this is cool)
o Similar search for more on Mark Twain
b. If you haven’t used the links under “Expand Your Search” and/or the
“Additional Searches” button in the past would you consider using them now?
o Uses frequently especially during winter term research papers
o – Yes I like this and as a user I understand that there is more out there
o – Yes definitely – so many more options
o - Yes for research
o 1 – Yes this will make my research go more smoothly
o - Yes now that I know what they are
4) Does the order of the links and button under Expand Your Search matter to you?
o Amazon does not need to be there
o 2 - No but the box does not stand out
o Yes – cite this and academic search premier should be at the top
o Yes – Why is Amazon there? Cite it should be first the stuff for articles
o No – but I only noticed the first couple of items
5) a. Have you ever used the Book Review Digest Plus link?
o 6 - No
b. If so, were you satisfied with the results you found?
6) Now that you are familiar with the resources available in the “Expand Your Search”
do you think that you would prefer or use any of these items more than the others?
o Will use it more now that I know you can find articles
o I’ll use the Book Review, cite this item and world cat more often
o I’ll be using more of these choices for the paper I’m writing this weekend
o I will use World Cat, Cite it and Academic Search Premier
o Oh yes, searching is fun I like to know more in depth info, it’s very handy
o I’ll use Book Review Digest and Search 360, but Amazon could go
PathFinder Pro User Testing Report Page 5