Usability Research Project: U.S. Citizenship Test
Preparation Sites
Megan Stevenson
1
Introduction………………………………………………………………….3
The Websites…………………………………………………………………3
Methodology………………………………………………………………….5
Data Collection……………………………………………………………….8
Results………………………………………………………………………...9
Discussion……………………………………………………………………20
Recommendations…………………………………………………………...21
Summary…………………………………………………………………….22
References used……………………………………………………………...22
Related links on the web for the topic……………………………………...22
Appendix……………………………………………………………………..23
2
Introduction
One of the main steps to obtaining American citizenship is the successful completion of
the U.S. citizenship test. Before taking the test, an immigrant who wishes to become an
American citizen must sharpen his/her English skills, as well as become familiar with
U.S. history and government. Often the test preparation is conducted in a GED classroom
or Citizenship Prep class. Once the student is ready, he/she takes the citizenship test and
is also interviewed by an INS officer.
I am interested in adult education and specifically immigrant education. I am familiar
with the face-to-face preparation for the U.S. citizenship test. My mother was a GED
instructor, who often helped non-native students study for the test. I was curious what
online preparation resources were available to these types of students. I chose to research
three U.S. citizenship test prep sites. In this study, I hoped to find out how well these sites
prepared the immigrant user for the test and interview process, and how usable the sites
would be for a non-native user. I also chose to conduct this study to see how the online
educational resources available to the immigrant user could be improved. The results of
this study may benefit those who design and build U.S. citizenship preparation sites as
well as those who hope to become American citizens.
The Websites
I picked three U.S. citizenship sites based on the following criteria:
Free resources – the site must provide some free educational resource to the user.
I eliminated sites that required the user to pay for the bulk of information.
Immediate information – the site must give the user immediate information
regarding the test and interview. I eliminated sites that required the user to “send
away” for more information. I did not eliminate sites that required the user to
register and log in for certain pieces of the site, as long as the majority of the
content was immediately accessible.
Relevant content – the site must contain information about how to prepare for the
test and interview. I eliminated sites that didn’t contain useful information for the
would-be American citizen.
Site #1: Preparing for the U.S. Citizenship Interview
http://aenet.esuhsd.org/Citizenship_lessons/Citizen/index.html
The first site chosen is a subsite of the East Side Adult Education website. I chose this
site because of the simplicity of the interface and the categorization of the information.
The site contains interactive sample tests, sample interview questions and access to other
citizenship preparation resources.
3
Site #2: NRI Links – Immigration
http://www.nrilinks.com/immigration/Citizenship/prep.htm
The second site is a subsite of the NRI Links site. The main NRI Links site is a one stop
portal for non-resident Indians. This subsite was chosen because of sample test questions
and the frequently asked questions page. The site provided relevant information an
immigrant might need to know before going to a citizenship test.
4
Site #3: INS Experts
http://www.insexperts.com/en/nat/natintroduction.htm
The third site was a subsite of the INS Experts site. The INS Experts main site’s tagline
states “INS forms, naturalization forms and green card renewal services from INS
Experts simplify the process of applying for American citizenship.” The subsite was
chosen because of the wealth of citizenship information available, as well as the clear
organization of navigation. The site also provided an interactive eligibility quiz, sample
tests, and useful individualized, age-appropriate information for immigrant users.
Methodology
Participants
I asked two participants to evaluate the U.S. citizenship preparation sites. I did not have
direct access to the specific immigrant user population that would normally use these
sites. However, my two participants shared some of the same characteristics as the
immigrant user population. Both of my participants were international students and
neither of them were American citizens. English was not their first language and they did
not have any familiarity with the steps to necessary to becoming an American citizen.
While these tests participants may have lacked the same motivation that an immigrant
user might have, I felt the characteristics of my test users gave me more accurate research
results than if I had tested American citizens whose first language was English.
5
The following demographic information was captured in a pre-test questionnaire.
Test User #1
Name: Ching-O Hsin
Age: 30
Country of Origin: Taiwan
First Language: Taiwanese, Chinese
Relevant characteristics: Medium English skills, Medium computer skills, Comfortable
using technology – uses internet 4 hours per day and has been using computer for 13
years.
Test User #2
Name: Chung-Kai Huang
Age: 30
Country of Origin: Taiwan
First Language: Chinese, Taiwanese
Relevant characteristics: Somewhat high English skills, Comfortable using technology –
uses internet 6 hours per day and has been using computer for 12 years
Tasks
The usability tasks were based on Nielsen’s Methodology (Nielsen et al., 2000) and
divided up into three areas (exploration, specific, open-ended). The users were first asked
to explore the site and give first impressions. Then the users were given three specific
tasks to complete. Finally the users chose from two of the open-ended tasks to
accomplish for each site.
Task #1
Exploration: The participants were given a short period of time to explore the site. They
were then asked to give their first impressions about the usefulness and usability of the
site.
These are the questions the users answered after the exploration period:
What do you think this site is about?
Who do think this site is built for?
What is your first reaction or impression of the site’s organization and design
Do you think it would be easy for the user to find the information he/she is
coming to the site to find?
Task #2
Specific: The test users were given three specific tasks to complete for each site. The
three tasks were related by topic across sites, but some tasks varied because of site
specific content.
6
These are the tasks the users attempted to accomplish during the specific task period:
Site #1
Prepare for the test by learning about voting and what month American citizens
vote for their president.
Find a practice test and try out a few questions.
Find a sample Citizenship interview and download the document for later review.
Site #2
Prepare for the test by finding information about the Colonial Period and
specifically the French and Indian war.
Find a practice test/sample questions and try out a few questions and find sample
answers.
Find out what to do if INS denies your application for citizenship.
Site #3
Find examples of the types of sentences an INS officer may ask you to read aloud
or write during your interview.
Find out if you are eligible by taking the eligibility quiz.
Find out what the physical residency requirement is for all applying for
citizenship.
After each specific task the users were asked the following questions:
1. How easy was it to find the information?
2. Did you run into difficulties? If so, what?
The users then wrote their answers down and verbally shared their reactions and
impressions.
Task #3
Open-ended: At this stage in the testing the users were given two open-ended scenarios to
choose from. The participants each chose one open-ended task and attempted to complete
the tasks and gather the relevant information.
These are the two open-ended tasks from which each participant chose:
Look for the steps that you think are important to becoming a citizen.
You would like to find out more about the test and the interview. Explore the sites
to find out helpful information about how and where you can take the test.
After the users felt they had completed the task they answered these questions:
1. Where you able to find the information you needed for your open-ended tasks?
2. What did you learn from your interaction with the sites?
The participants then wrote their answers down and verbally shared their answers and
impressions.
7
Data Collection
Pre-test questionnaire
Once the participants had signed the consent form, they were asked to complete a pre-test
questionnaire. The questionnaire asked for demographic information, level of technology
experience and any previous knowledge of the steps needed to attain American
citizenship. The participants were asked about their country of birth and first language to
find out if they would have some of the same characteristics as the actual immigrant users.
The participants were also asked about their technology experience to see if this would
affect their interaction with the three sites. Finally, they were asked about their
knowledge about the steps needed to attain American citizenship to see if they were
familiar with the sites I was asking them to test. I was concerned familiarity with the sites
may skew the usability research results.
Task completion and researcher involvement.
First, I gave an overview of the test structure and an explanation of the types of sites the
individual participant would be reviewing. I explained why I was testing the sites and
what was expected of the user. I then sat behind the user and took written notes while the
user completed the task. I answered any minor questions that did not disrupt the research.
I kept my involvement in the task completion to a minimum.
Each participant was given five minutes to explore the site and then was asked to
complete a few general site-related questions. The user was then asked to complete three
specific tasks for each site. I captured the user’s interactions for each specific task by
using Captivate software. I took notes during each task about the interactions I saw, and
about the verbal reactions of the user. At the completion/or unsuccessful completion of
each task, I saved the interaction in a Captivate file. After the specific tasks were
completed, the user was asked to choose one open-ended task to complete. Since the
open-ended tasks took much longer than the specific tasks and involved more exploration,
I chose not to capture the interactions in Captivate, and instead took written notes on the
user’s interactions with the site.
Site feedback questionnaire
Once the user felt he/she had completed the open-ended task, he/she was asked to
complete a site feedback questionnaire. The questionnaire contained general questions
about what the user did and did not like about the site as well as scaled questions about
the information, interaction and interface design of the site.
Recommendations
After the user completed the questionnaire, he/she was asked to verbally discuss
recommendations for improvement of the information, interaction or interface design of
the sites. The user was encouraged to be specific and was asked further questions if the
answers were vague or incomplete. I took notes on the user’s recommendations for each
site.
8
Results
The following results are divided up by website and contain each participant’s experience
with each task. Each result is also accompanied by a screenshot from the Camtasia files
and notes on whether the task completion was successful or unsuccessful.
Site #1 – Preparing the US Citizenship Interview
(http://aenet.esuhsd.org/Citizenship_lessons/Citizen/index.html)
Exploration task – After looking through the first site, both participants felt this site was
built to prepare people to become U.S. citizens with relevant knowledge and skills.
Specifically, the users felt that this site was created to assist with the preparation for the
U.S. citizenship interview. The site provided access to relevant citizenship information
and test-based practice. One user’s first impression of the site was that it was well-
organized and quite clear and easy to find the information needed. The information was
divided up into four obvious categories and the interface was quite simple. The female
user felt that it would be quite easy to find the information she was coming to the site to
find, while the male user felt it would depend on the language proficiency of the site
visitor.
Specific Task #1 – The first task required the participants to find specific information
within the subpages of the site. The users were asked to find out about U.S. voting and
what month American citizens vote for their president. One user felt it was not easy to
find the specific content. She remarked that there was too much information on the pages
for browsing. The other user felt the while the information was not too difficult to find,
he would have had an easier time if there would have been a search box on the pages.
9
Site #1 Task #1 Success:
Specific Task #2 – The second task required the participants to find a practice test and
then to try out a few questions. Both users were able to accomplish this task and felt it
was easy to find the information. One user remarked that the task was easy because the
title for the test was prominently placed on the homepage.
10
Site #1 Task #2 Success:
Specific Task #3 – The third task required the users to locate a sample citizenship
interview and then download the document. One user felt it was very easy to find the
print-out section of the site that contained the sample interview. This user did not run into
any difficulties. The other user experienced task failure. She tried several possible
sections of the site when searching for the interview, but was still unable to find it. The
usability tester noticed that the user had found this information on accident during the
exploration task. During the specific task, the user became stuck within the interview
section and wasn’t able to find the correct print-out.
11
Site #1 Task #3 Task Failure:
Open-ended Task – The final task required the participants to pick between two different
open-ended scenarios. Both users picked the scenario that required them to find out more
about the test and interview and how and where to take the test. Both users felt this
information was easy to find and that the navigation and content easily led them to the
correct information.
Site feedback questionnaire – In the site feedback questionnaire, the users were asked
short answer questions about their opinions about the site. One user liked that Site #1 had
a simple interface and the other user felt the site was 95% good. When asked what they
didn’t like about the site, one user felt there was too much information on the pages and
that the site needed more chunking of content. The other user didn’t like how the
interface did not use the full screen space. She preferred a liquid layout to the narrow,
fixed width of the site. She also didn’t like that the site did not have a search box or a
page with any contact information. She remarked that there would be no way to contact a
webmaster or content developer with any questions.
The users were then asked to answer three simple questions by selecting a number on a
scale of 1-5. The site received an average of 3.5 on the ease of the ability to accomplish
the tasks. The site received an average of 4 for the lack of problematic issues experienced
when interacting with the site, and an average of 4 for usefulness of the site to a person
who is interested in becoming an American citizen. The users were then asked more
detailed questions in order to obtain their impressions of the site’s information,
interaction and interface design. These questions were also set up with a scale of 1-5. The
12
information design of the site received an average of 3.5. The interaction design received
an average of 3.1. The interface design received an average of 3.6.
Site #2 – NRI – Links – Immigration
http://www.nrilinks.com/immigration/Citizenship/prep.htm
Exploration task – When exploring the second site, both participants felt that the site was
set up to prepare immigrant users for the citizenship test and INS interview. The
participants also felt that the site was built for users who wanted to become familiar with
the steps for naturalization. One user did not feel that it would be easy for a user to find
the information he/she is coming to the site to find. The other participant felt that the
organization of the home page made it difficult to find any specific topic in the site.
Specific Task #1 – The first task asked the users to find information about the Colonial
Period and specifically about the French and Indian war. One user felt it was very easy to
find the information and ran into no difficulties in his search. The other user felt it was
not too difficult to accomplish the task, but also felt that she “accidentally” found the
information and the success of the task was more due to luck then the design of the
interface of the site.
13
Site #2 Task #1 Task Success:
Specific Task #2 – The second task asked the users to locate a practice test and see if they
could try out a few questions. Both users felt that it was easy to find the test. One user
was disappointed by the static structure of the test and the fact that there was no feedback
for any of the sample questions.
Site #2 Task #2 Task Success:
14
Specific Task #3 – The third task asked the users to find out what to do if INS denies an
application for citizenship. One user felt it was somewhat easy to find this information,
but was unsure where to start from the content on the homepage. The other user felt it
was easy to find the information, and her common sense led her to the information. She
also felt that the content on the home page was not helpful for this task and that nowhere
were the letters INS defined. She was concerned about this lack of definition because she
felt that the actual users might not know how to obtain the information.
Site #2 Task #3 Task Success:
Open-ended Task – Both participants chose the second open-ended task for Site #2. The
task asked the users to find out more about the test and interview and where and how one
could take the test. One participant easily found the information he was looking for,
including information about U.S. history, a study guide, government structure, and other
information related to the test. The other participant found the information about how to
take the test, but was unable to find where she would take the U.S. citizenship test. She
felt the site provided a study guide only, and there was too much information that was not
well-organized and not user-friendly.
Site Feedback Questionnaire – When asked what she liked about the site, the female
participant felt that the site had a lot of information and was built to be helpful to the user.
The male participant wrote that there wasn’t much to like about the site. He didn’t like
the small font-size on the pages, and felt that the text was difficult to read. The female
participant also felt the font was too small and the content was too wordy. She thought
home page was poorly designed and not attractive.
On a scale of 1-5, the site received an average of 3.5 for ease of interaction and
accomplishment of tasks. The site received an average of 3 for lack of problematic issues
15
during interaction, and a 3.5 for the usefulness of the site for someone who wants to
become an American citizen. In the more detailed information, interaction and interface
design questions, the site received an average of 2.9 for information design, a 1.8 for
interaction design and a 2.7 for interface design.
Site #3 – INS Experts
http://www.insexperts.com/en/nat/natintroduction.htm
Exploration task – After exploring the third site, both participants felt the site was set up
to provide information and online services regarding U.S. citizenship and naturalization.
The male participant’s felt that the site organization was not bad, but the font was small
and sections of the site were too wordy. The female participant wrote that the site
contained nice colors and navigation tools. Both users felt that the immigrant user would
have an easy time finding the information he/she is coming to the site to find.
Specific Task #1 – The first task for this site asked the participants to find examples of
the sentences an INS officer may ask a test-taker during the U.S. citizenship interview.
The male participant felt this task was not too difficult and he did not run into any
problems when attempting to accomplish the task. The female user did not feel that the
task was easy and she was unsure sure if she had found the correct content when she
successfully completed the task.
16
Site #1 Task #1 Task Success:
Specific Task #2 – The second task required the participants to find out if they were
eligible for U.S. citizenship by taking the citizenship eligibility quiz. One participant felt
it was easy to find the specific information and did not run into difficulties. The other
participant felt it was somewhat easy to find the information, but that it took her time to
locate the content and make sure she was at the right place.
17
Site #3 Task #2 Task Success:
Specific Task #3 – The third task required the participants to find the physical residency
requirement for applying for American citizenship. Both users felt it was easy to find the
information and neither user ran into any difficulties.
18
Site #3 Task #3 Task Success:
Open-ended Task – Both users chose the open-ended task that asked the user to find out
more about the test and interview and where and how to take the test. The male user felt
it was easy to find the relevant information and that navigation and links were prominent
and helpful. The female user also felt it was easy to accomplish the task and that the
different types of questions and test items were age appropriate for different types of
users.
Site Feedback Questionnaire – When asked what the users liked about the site, one user
felt that this site was the most informative of all the three sites. The other user liked the
layout, color scheme, consistent navigation and prominent site ID of the third site. The
male participant did not like the size of the font and the lengthy content on some of the
pages. The female participant also did not like the font size.
On a scale of 1-5, the site received an average of 4 for the ease of accomplishing the tasks.
The site also received an average of 4 for the lack of problematic issues during site
interaction and an average of 4 for the usefulness of the site for a user who wanted to
become an American citizen. In the specific questions about information, interaction and
19
interface design, the site received an average of 3.8 for information design, 3.2 for
interaction design and 3.8 for interface design. The third site received the highest scores
in the questionnaire, and the most positive verbal and written feedback from both of the
participants.
Discussion
Here are the detailed results of the feedback questionnaire and the rating of each site in
information, interaction and interface design.
Site #1: Preparing Site #2: NRI Links Site #3 – INS
for the U.S. – Immigration Experts
Citizenship
Interview
General 23/30 20/30 24/30
Usability/Usefulness
Information 28/40 24/40 31/40
Interaction 25/40 15/40 26/40
Interface 29/40 22/40 31/40
Total 105/150 81/150 112/150
Site #3 – INS Experts came out with the most points for general usability, information,
interaction and interface design. Site #1 was a close second and Site#3 came in at a
distant third at 81 out of 150.
Discussion of Results
General Usability/Usefulness – In order for the citizenship tests to be useful and usable
for the users, the participants felt that the site must be easy to go through and the tasks
must be easy to accomplish. There should be few problems in the interaction with the site
and the site should provide useful information for the user who wants to become an
American citizen.
Information Design – The participants felt that the information on the site must be clear
and well-organized. Another important aspect of information design was the access to
helpful content. The sites that scored the highest in the information design scale gave the
users easy access to helpful and useful web content.
Interaction Design – In order to have a high score in interaction design, the sites must
provide meaningful feedback during interaction. The site should also provide different
content for different types of users and address the individual user’s needs. Another
aspect of interaction design is the access to useful interactive tools, including practice
tests and sample interviews.
20
Interface Design - A successful score in the interface scale required the site to be
attractive and well-designed. The visual style of the site must be consistent throughout
the site to avoid confusing the user as to where he/she is in the site. The text, graphics and
white space must be well-balanced and the interface design provides a visual
representation of the site’s goal.
Recommendations
These are the recommendations the users wrote or discussed verbally during and after
completing the usability tasks.
Site #1 – Preparing the US Citizenship Interview
(http://aenet.esuhsd.org/Citizenship_lessons/Citizen/index.html)
Both users recommended more chunking of the content of the site. The male user felt the
site would be easier to navigate if the information was organized in a more useful fashion.
He also felt that the information was not set up for low language proficiency. He
remarked that users who are currently learning English may have a difficult time with
some of the vocabulary. Both users also recommended a search box on all pages of the
site. This way the user could find the specific information that he/she came to the site to
find. The site contains much useful content, but some of it is buried in subpages, or exists
on pages that are not obvious to the user. A search box and reorganization and chunking
of the content would solve this problem.
Site #2 – NRI – Links – Immigration
http://www.nrilinks.com/immigration/Citizenship/prep.htm
One recommendation for Site #2 was to improve the graphic design of the site. The
female user did not feel that the interface design reflected the goal of the site. There was
no indication in the design to let the user know that he/she was on an immigration site.
She felt the addition of flags, or other graphical representations of U.S. immigration
information would solve this problem. Both users felt the font size was too small,
especially for older users who may not be able to read the small text. The male user also
noted that older users may not know that they can change the size of the font themselves.
He recommended that the default/normal font size should be slightly bigger for easy
scannability. The male participant recommended placement of breadcrumbs on the
subpages of the site, so the user could easily navigate back to the home page. Both users
recommended the addition of a search box to the site, so the users could easily find
specific information.
Site #3 – INS Experts
http://www.insexperts.com/en/nat/natintroduction.htm
The female participant felt that the content of Site #3 was often too wordy and not easily
scannable. She remarked that the chunking of information would make for easier
21
readability. She also felt that the font size could be larger for scannability. The male
participant felt that Site #3 was the easiest site to use out of all three sites. He pointed out
the consistent navigation and layout, the clear categorization of content, age-appropriate
materials, individualized usability and a professional interface design. He felt that with
the addition of a search box and larger font size, the site would be even more usable and
useful. He also recommended multilingual translation of the content for the users that do
not yet speak English.
Summary
I conducted this study in order to find out how useful and usable citizenship preparation
sites are for users that are not American citizens. I was also interested in discovering how
the information, interface and interaction design of these types of test preparation sites
could be improved.
The participants in this usability study completed a demographic questionnaire, an
exploration task, three specific tasks and a site feedback questionnaire. During the task
completion, I observed and recorded the participants’ interactions with the site. After
completing the tasks and questionnaires, the users gave recommendations on improving
the design of all three sites. At the conclusion of the study, both users concluded that the
third site, INS Experts, had the best information, interaction and interface design. The
participants felt the third site would be the most useful for a user who wished to learn
more about how to become an American citizen.
References Used
Krug, S. (2000). Don't Make Me Think! A Common Sense Approach to Web
Usability. Berkeley, CA, New Riders Publishing.
Nielsen, J., Snyder, C., Molich, R., and Farrell, S. (2000). E-Commerce User
Experience: Methodology. Nielsen Norman Group.
Related Links on Web for Topic
Preparing for the U.S. Citizenship Interview
http://aenet.esuhsd.org/Citizenship_lessons/Citizen/index.html
NRI Links – Immigration
http://www.nrilinks.com/immigration/Citizenship/prep.htm
Site #3: INS Experts
http://www.insexperts.com/en/nat/natintroduction.htm
22
Appendix
Megan Stevenson
04/07/07
Usability Research of Citizenship Test and Interview Preparation Sites
Overview
I am researching the usability of sites that prepare the user to take the U.S. Citizenship
test. I hope to find out how effective these sites are at test and interview preparation and
how usable the sites are for ESL users from other countries. This study should take about
1 hour. I will be sitting at the computer with you and taking notes while you peruse the
sites and accomplish the usability tasks.
Pre-test questionnaire
Name: ______________________________
Age: ________________________________
Country of origin: ____________________________
American citizen? Yes No
Familiarity with the citizenship steps and requirements? Yes No Somewhat
What language is your first language? __________________
Please rate your English skills:
Low 1------2-------3-------4-------5 High
How comfortable are you using a computer?
Not comfortable at all 1--------2--------3---------4---------5 Very comfortable
How comfortable are you using the internet?
Not comfortable at all 1--------2--------3---------4---------5 Very comfortable
How many hours per day do you use the internet? _____
How many years have you been using the computer? ____
23
Citizenship Test and Interview Preparation sites
Site #1 - Preparing for the US Citizenship Interview
http://aenet.esuhsd.org/Citizenship_lessons/Citizen/index.html
Site #2 - NRI Links – Immigration
http://www.nrilinks.com/immigration/Citizenship/prep.htm
Site #3 - INS Experts
http://www.insexperts.com/en/nat/natintroduction.htm
5 minutes for exploring the site/first impressions
Questions for first impressions:
What do you think this site is about?
Site #1 Site #2 Site #3
Who do you think this site is built for?
Site #1 Site #2 Site #3
What is your first reaction or impression of the site’s organization and design?
Site #1 Site #2 Site #3
Do you think it would be easy for the user to find the information he/she is coming to the
site to find?
Site #1 Site #2 Site #3
24
Tasks for Site #1 (http://aenet.esuhsd.org/Citizenship_lessons/Citizen/index.html)
Prepare for the test by learning about voting and what month American citizens
vote for their president.
How easy was it to find the information?
Did you run into difficulties? If so, what?
Find a practice test and try out a few questions.
How easy was it to find the information?
Did you run into difficulties? If so, what?
Find a sample Citizenship interview and download the document for later review.
How easy was it to find the information?
Did you run into difficulties? If so, what?
Tasks for site #2 (http://www.nrilinks.com/immigration/Citizenship/prep.htm)
Prepare for the test by finding information about the Colonial Period and
specifically the French and Indian war.
How easy was it to find the information?
Did you run into difficulties? If so, what?
Find a practice test/sample questions and try out a few questions and find sample
answers.
How easy was it to find the information?
Did the practice test give you any feedback? If so, what?
Find out what to do if INS denies your application for citizenship.
How easy was it to find the information?
Did you run into difficulties? If so, what?
25
Tasks for site #3 (http://www.insexperts.com/en/nat/natintroduction.htm)
Find examples of the types of sentences an INS officer may ask you to read aloud or
write during your interview.
How easy was it to find the information?
Did you run into difficulties? If so, what?
Find out if you are eligible by taking the eligibility quiz.
How easy was it to find the information?
Did you run into difficulties? If so, what?
Find out what the physical residency requirement is for all applying for citizenship.
How easy was it to find the information?
Did you run into difficulties? If so, what?
Open-ended tasks for all sites–
Look for the steps that you think are important to becoming a citizen.
You would like to find out more about the test and the interview. Explore the sites to
find out helpful information about how and where you can take the test.
Where you able to find the information you needed for your open-ended tasks?
What did you learn from your interaction with the sites?
26
Name:
Date:
Site Tested:
Site Feedback Questionnaire
What did you like about the site?
What didn’t you like about the site?
It was easy to go through this site and accomplish the tasks
Not easy at all 1 2 3 4 5 Very Easy
I had a lot of problems interacting with the site.
Very True 1 2 3 4 5 Not True At All
How useful do you think site is for someone who wants to become an American
citizen?
Not useful at all 1 2 3 4 5 Very useful
Strongly Strongly
Information Design
Disagree Agree
The information was clear and well-organized 1 2 3 4 5
The text on each page was scannable and easy to
1 2 3 4 5
read.
The information was helpful and useful. 1 2 3 4 5
It was easy to find the information needed for each
1 2 3 4 5
task.
27
Strongly Strongly
Interaction Design
Disagree Agree
I knew where I was in the site at all times. 1 2 3 4 5
The site provided useful interactive tools, such as
1 2 3 4 5
practice tests and sample interviews.
The site gave meaningful feedback during
1 2 3 4 5
interaction.
The site provided different options for different types
of users, (examples: immigrants 65 or older, newly 1 2 3 4 5
arrived immigrants, etc.)
Strongly Strongly
Interface Design
Disagree Agree
The site interface was attractive and well-designed. 1 2 3 4 5
The visual style was consistent throughout the
1 2 3 4 5
pages.
The text, graphics and white space are well
1 2 3 4 5
balanced.
The interface design of the site provided a visual
1 2 3 4 5
representation of the site’s goal.
28
Author info
This paper is written by Megan Stevenson for the course EDC385G Designs & Strategies for New Media at
The University of Texas - Austin
29