Purpose:
Status of Testing:
Testing Preparation:
This document is aimed as a record to document the procedure and results of the tests carried out. It gives the detailed step by
step procedure, for each test case and specifies how the expected output and the observed output for a specific instance of
when the test was last carried out. It differs from the Test Plan and cases document as it specifies, to a greater level of detail,
the steps necessary for carrying out each test and also gives the specific results of the observed version, of the test outcome.
All regression tests have been carried out, and three rounds of these tests have been conducted, one after CCD.New tests have
been added based on the new functionalities implemented after CCD. The order of testing has been determined by the Value
Based testing spreadsheet, and the tests have been carried out based on the satisfied dependencies first and the priority value
second. All defects have been tracked using Bugzilla as a defect tracking tool.
2.1 Hardware preparation
The hardware used for the testing procedures is as follows
1. One Dell Inspiron 600m laptop, 32 bit processor, 512 MB of RAM, 60 GB hard disk, operating on a Windows XP
environment. Laptop is privately owned by team member and is password protected. This piece of hardware will be used to
perform manual, automated and user testing.
2. One HP dv-4t entertainment laptop, 64 bit processor, 4 GB RAM, 520 GB hard disk, operating on a Windows Vista
environment. Laptop is privately owned by team member and is password protected. This piece of hardware will be used to
perform manual, automated and user testing.
3. One Mac Book Pro, 64 bit processor, 4 GB RAM, 250 GB hard disk, operating on Mac OS Snow Leopard. Laptop is not
privately owned, but can be used for testing purposes as and when needed. It is password protected. This piece of hardware
will be used to perform manual, automated and user testing.
2.2 Software preparation
The software preparation for the testing procedures consists of installation of the development environment and IDE
environment, which serves as the source of data to test, and also opens windows of opportunity for both front end user
interface and backend database testing
• Eclipse Galileo
• JDK 1.6
• Apache Tomcat 6
• MySQL 5.1
• Subversive Plug-in for Eclipse
The development environment must be deployed on the testing box as before the project is deployed on the final server, we
should be able to run the timeline web interface locally to test it using web interface testing tools such as eValid as described
below.Windows Virtual PC running Windows 7, with the specified browsers, i.e. Firefox 3.0+, IE 7.0+, and Safari 3.0+
Additional Testing tools include
• eValid v9 (free trial version)
• Selenium IDE
• XPather plug-in for Firefox
• Firebug plug-in for Firefox
EValid is a resourceful web browser testing tool which allows us to automate tests which are based on web tests, and tests the
functionality of browser based code by recording a series of actions into a test suite. It also has the capability to simulate load
Testing Date
:03/23/10-
03/26/10
Test Case Input Specifications &
Test Item Test Type Pre-conditions Post-conditions Expected Output
Number Steps Description
TC-01-01 Test ability of Valid a. a. Administrator Step1: Administrator clicks ->The Timeline
administrator to Administrator sees the on the "Account Login" link homepage is
login using valid has access to "Administrator in the navigation bar. opened, and the
credentials the timeline functions" tab in the navigation bar
system. navigation bar. Step2:Administrator fills in shows
b. Administrator sees the details - Email: "Administrator
the 'Welcome John "timeline_a@yahoo.com " Functions" Link
Admin' message. Password: “hello123456”
and Clicks ‘Sign In". ->"Welcome John
Admin" message is
seen on the right
hand upper corner
of the page.
TC-01-02 Test inability of Invalid a. a. Step1: Administrator clicks Administrator is
administrator to Administrator Administrator is on the "Account Login" link shown error
login using invalid has access to shown error in the navigation bar. message on the
credentials the timeline message on the login page, stating
system. same login page, Step2:Administrator fills in that the password,
stating that the the details - Email:” the email address
password or email timeline_a@r.com “ or both are invalid.
address or both is “ Password:
invalid “hello123456” and Clicks
‘Sign In".
TC-02-01 Test ability of Valid a. a. New moderator Step1: Administrator clicks New moderator
administrator to Administrator account appears as on Administrator functions account appears as
create a new must be logged an entry in the list of link. an entry in the list
moderator account into the system moderator accounts Administrator clicks on of moderator
in the administrator Add account under accounts in the
functions page Manage Moderator administrator
Accounts. functions page as
Step2: Administrator Moderator:
enters the moderator First Name: Sally Reese,
Name as "Sally", Email:
middlename as, "R", the timelinetester@yah
last name as "Reese", oo.com,
salutation as "Ms", email Organization: USC
as
"timelinetester@yahoo.co
m", password as,
"hello555", and
occupation as "Teacher"
Step 3: Perform TC-03-01,
it should pass.
TC-02-02 Test ability of Valid a. a. Step 1: Click delete button a.
administrator to Administrator timelinetester@yaho next to timelinetester@yah
delete existing must be logged o.com no longer timelinetester@yahoo.com oo.com no longer
moderator account into the system appears in the list of , under the Manage appears in the list
and there must moderator accounts Moderator Accounts of moderator
be at least one in the administrator Module, on the accounts in the
existing page administrator functions administrator page.
moderator page. b. Sign in attempt
account Step 2: Perform TC-03-01, using the
and it should fail. credentials of
Moderator, gives
error message,
Email or password
invalid, i.e. TC-03-
01 fails
TC-03-01 Test ability of Valid a. Moderator a. Moderator sees Step1: Moderator clicks on The Timeline
Moderator to Login has access to the "Moderator the "Account Login" link in homepage is
with valid the timeline functions" tab in the the navigation bar. opened, and the
credentials system. navigation bar. Step2: Moderator fills in navigation bar
b. Moderator sees the details - Email:” shows "Moderator
the 'Welcome Sally timelinetester@yahoo.com Functions" link, i.e.
Reese" message on Password: “hello555” Moderator Specific
the upper right hand and Clicks ‘Sign In". Navigation bar is
corner of the page. displayed.
"Welcome Sally
Reese message" is
seen on the right
hand upper corner
of the page.
TC-03-02 Test inability of Invalid a. Moderator a. Step1: Moderator clicks on Moderator is
Moderator to Login has access to Moderator is shown the "Account Login" link in shown error
with invalid the timeline error message, the navigation bar. message on the
credentials system. stating that the Step2: Moderator fills in login page, stating
password or email the details - Email:” that the password,
address is invalid timelinetester@usc.eduPas the email address
sword: “hello555” and or both are invalid.
Clicks ‘Sign In".
TC-04-01 Test ability to Valid a. Contributor a. Contributor Step 1. Contributor clicks Page tells user the
create contributor has access to registration is on "Contributor account for
account the timeline successful and Registration link" timelineuser@yaho
system. appropriate message Step 2. Contributor fills in o.com has been
stating that, details as follows created and must
contributor account First Name: Rebecca be approved by a
will be approved by Last Name: Mei moderator before
moderator. Email: the user can use
B. Moderator on timelineuser@yahoo.com the account
login can see the Password: user555
user request by Organization: GTeck
clicking on the Step 3. Contributor clicks
Moderator functions on Submit button
link and checking for
the corresponding
contributor under
the Manage
Accounts module
TC-05-01 Test ability of Valid a. Contributor a. Contributor sees Step1: Contributor clicks The Timeline
contributor to log in has access to the "Add source", on the "Account Login" link homepage is
with valid the timeline "Add Timeline Item" in the navigation bar. opened, and the
credentials system. and "Submit navigation bar
comment" links in Step2:Contributor fills in shows "Submit
the navigation bar. the details - Email:” Comment" link,
b. Contributor sees timelineuser@yahoo.com "Add Timeline
the 'Welcome “ “ Item", Add Source",
Rebecca' message. Password: “hello555” and i.e. Contributor
Clicks ‘Sign In". Specific Navigation
bar is displayed.
"Welcome Rebecca
Wei message" is
seen on the right
hand upper corner
of the page.
TC-05-02 Test inability of Invalid a. Contributor a. Contributor is Step1: Contributor clicks Contributor is
contributor to log in has access to shown error on the "Account Login" link shown error
with invalid the timeline message, stating that in the navigation bar. message on the
credentials system. the password or login page, stating
email address, or Step2:Contributor fills in that the password,
both is invalid. the details - Email:” the email address
timelineuser@usc.edu“ or both are invalid.
“ Password:
“hello555” and Clicks ‘Sign
In".
TC-06-01 Test ability of Valid a.Contributor Submission page Step 1: Contributor clicks Submission page
contributor to has access to redirects to on 'Add Source' in the redirects to
submit content- the timeline Homepage and a navigation bar. Homepage and a
Source. system. message, Step 2: message,
b. Contributor "Submission was Contributor fills out the "Submission was
is logged in. successful. You will following fields successful. You will
c. Moderator receive an email Book/Journal Submission receive an email
has access to when the source has information specified as when the source
the timeline been approved or follows has been approved
system. denied. " is displayed Timeline Item Name: or denied. " is
Bibliography of Western displayed.
works on early medieval b. When the
Timeline: Chinese moderator logs into
Subject/(s): bibliography moderator
Type: Regime account, he is able
Start Date: January 1-180 to see the
AD submitted source
End Date: January 1-190- under recent
AD changes.
Step 3: Contributor clicks
on Submit button.
Step 4:Moderator logs on
and goes to recent
changes, and checks for
F10asource submitted by
Rebecca Wei.
TC-06-02 Test ability of Valid a.Contributor Submission page Step 1: Contributor clicksSubmission page
contributor to has access to redirects to on 'Add Timeline Item' in redirects to
submit content- the timeline Homepage and a the navigation bar. Homepage and a
Timeline Item system. message, message,
b. Contributor "Submission was Step 2: "Submission was
is logged in. successful. You will Contributor fills out the successful. You will
c. Moderator receive an email following fields receive an email
has access to when the source has Book/Journal Name=Toung when the source
the timeline been approved or Pao has been approved
system and denied. " is displayed Timeline Item Name: or denied. " is
internet access. The bestowal of surnames displayed.
under the Western Wei-- b. When the
Northern Chou: a case of moderator logs into
counter-acculturation moderator
Author Last Name: Dien account, he is able
Author First Name:Albert to see the
Author Middle Name: E submitted source
Language: Chinese under recent
Subject :Northern Zhou changes.
Volume: 63
Issue: 2-3
Publication Date: 1997
Pages:137-77
Step 3: Contributor clicks
on Submit button.
Step 4:moderator logs on
and goes to recent
changes, and checks for
Timeline Item submitted
by Rebecca Wei.
TC-08-01 Test ability of Valid Moderator Submission Step 1: Moderator goes to a. Page tells
moderator to logged in and at approved submission Recent Changes and goes moderator that the
approve a least one is visible in the to recent Timeline Items submission has
submission submission of timeline module. been approved,
type 'Regime' is Step 2: Moderator clicks and submission
in the system the approve button next to entry removed
the submission to be from the list of
approved submissions
Step 3: Moderator b. On navigating to
navigates to the Regime the regime
homepage and searches homepage, the
for the newly approved new Regime can be
regime.F13 seen between the
dates specified.
TC-08-02 Tests ability of Valid Moderator Submission denied Step 1: Moderator goes to a. Page tells
moderator to deny logged in and and contributor Recent Changes and goes moderator that the
a submission at least one receives to recent Timeline Items submission has
submission of confirmation email module. been approved,
type 'Regime' is Step 2: Moderator clicks and submission
in the system the deny button next to entry removed
the submission to be from the list of
approved submissions
Step 3: Moderator b. On navigating to
navigates to the Regime the regime
homepage and searches homepage, the
for the newly denied new Regime cannot
regime. be seen between
the dates
TC-11-01 Tests ability of Valid eValid installed eValid test succeeds. Step 1. Select LoadTest > Playback Complete
system to support on the testing New LoadTest, on the Page arrives, report
access by 25 platform eValid Toolbar. file shows the
simultaneous users error, Evalid script
Step 2. Click on the Create gives error, found
Script Line button to null " ", which is
generate a single line in validated as a false
the LoadTest Script. Hit the positive due to
Create Script Line button 4 component in
more times to create 25 SIMILIE code.
simultaneous users.
Step 3. Click the Save and
Load Script button to
transfer the script to
eValid.
Step 4. Press F6 to run
LoadTest or on the Toolbar
click LoadTest > Start
LoadTest.
Step 5. Open the report
file generated and validate
any errors, as being false
positive or actual errors.
TC-12-01 Test ability of 5 Valid Each Submissions created Step 1. Select 5 users, who Page tells each
contributors to contributor is in system fill out new submissions contributor the
submit submissions logged in and click the submit button submission has
at the same time on the page at the same been received and
time, after having entered will require
details such as Submission approval.
information (citation fields Moderator on login
such as title, author, can see all 5
publisher, pages, submissions in the
publication date, subject, recent changes
etc). page of the
Step 2. moderator logs on moderator
and verifies that 5 different functions.
submissions, Submissions
corresponding to the 5 created in the
different contributors exist system (verifiable
by moderator
logging in and
showing the
created
submissions in the
list submissions
page).
TC-13-01 Test uniformity and Valid and Browser setup User satisfaction, Step 1. Perform user logon 1. User interface
accessibility across Invalid on testing uniformity in test, user submission of and functional
selected browsers platform. interfaces found content test, preview of properties are the
submission test, on the same on all
different testing browser browser platforms.
platforms.
Step 2. Note for interface
and or functional
inconsistency between the
expected behavior.
TC-07-01 Test ability to Valid a. Contributor Submission preview Step 1: Enter the details as Message showing
preview timeline has access to page displayed given below “submission was
item prior to the timeline Timeline Item Name: successful, you will
submittal system. Bibliography of Western receive an email
b. Contributor works on early medieval when the timeline
is logged in. Timeline: Chinese item has been
Subject/(s): bibliography approved or
Type: Regime denied.” Also the
Start Date: January 1-180 preview of the
AD timeline item is
End Date: January 1-190- visible on the same
AD page.
Step 2: Click Submit button
TC-09-01 Test ability of Valid Moderator What’s. New, Recent Step 1: Moderator clicks Page tells
moderator to set logged into the data parameter on “What’s new” link from moderator that the
how much recently system modified. navigation bar, Step 2 : new value has been
updated data will User on log in can click on “Manage set.
be displayed see the configured content”, and enters the
amount of recent value in the text field
data under what’s under “Manage what’s
new. new”, as 4.
Step 3: Click on set new
value
TC-09-02 Test ability of Valid Most recently Contributor clicks on Contributor clicks on link Page displays the
contributor to view updated data link “Recent changes” What’s new link” most recently
the most recently displayed updated data,
updated data count, under under the What’s
matches recent what’s new link new link,, showing
data configuration is 4 up to 4 recently
by moderator updated
submissions
TC-10-01 Test ability to sort Valid Citations exist Citations page User clicks on an Page displays
citations in in the system, displayed with Northern_Zhou event and citations in
descending date at least one citations sorted by then clicks on the Sources descending order
order regime/event/in descending date. link of date as follows
dividual exists 1. "The bestowal of
in timeline, and surnames under
for this the Western Wei--
regime/event/in Northern Chou: a
dividual, there case of counter-
are at least two acculturation,"
citations T'oung Pao 63:2-3
(1977):137-77.
2. Biography of Yu-
wen Hu (translation
from the Zhou
Shu). Berkeley:
University of
California Press,
1962.
3. Accounts of
Western nations in
the history of the
Northern Chou
dynasty. Berkeley:
University of
California Press,
1959.
Assumptions Test Estimated Testing
Pass/Fail Criteria Traceability Dependencies Pass? Observed Results Bug#
and Constraints Priority Cost
The test is passed Administrator SSRD CR-03 NA VH L Y a. Log in is
if the administrator submits the same successful and
is able to access email and the page redirects
the Administrator password as to the Timeline
functions by configured in the homepage.
clicking on the database of the b.The navigation
Administrator system. bar shows
functions link from "Administrator
the navigation bar. functions" link
c. The page
shows a welcome
message
"Welcome John
Admin"
The test is passed Administrator SSRD CR-03 NA VH L Y Page throws
if the system submits an invalid error, "email or
provides the email but valid password or both
correct error password. invalid"
message saying
that an invalid
email address or
password or both
were entered.
The test is passed None SSRD CR-01 TC-01-01 VH M Y New moderator
if new moderator account appears
account appears as as an entry in the
an entry in the list list of moderator
of moderator accounts in the
accounts in the administrator
administrator functions page as
functions page and Moderator:
TC-03-01 passes. Name: Sally
Reese,
Email:
timelinetester@ya
hoo.com,
Organization: USC
The test is passed Test Case TC-02- SSRD CR-02 TC-02-01, TC- M M Y a.
if 01 has been 01-01 timelinetester@ya
timelinetester@yah passed, and the hoo.com no
oo.com moderator moderator longer appears in
account must be account for Sally the list of
deleted, and Reese, exists, and moderator
attempting to login Test case TC-01- accounts in the
using this 01 has passsed administrator
moderator’s and administrator page.
credentials should is logged into the b. Sign in attempt
fail, i.e. TC-03-01 timeline. using the
fails. credentials of
Moderator, gives
error message,
Email or
password invalid,
The test is passed Moderator SSRD CR-03. TC-02-01, TC- VH L Y a. Moderator
if the Moderator is submits the same 01-01, sees the
able to access the email and "Moderator
Moderator password as functions" tab in
functions by configured in the the navigation
clicking on the database of the bar.
Moderatorfunction system. b. Moderator
s link from the sees the
navigation bar. 'Welcome Sally
Reese" message
on the upper
right hand corner
of the page.
The test is passed Moderator SSRD CR-03 TC-02-01, TC- VH L Y Moderator is
if the system submits a 01-01 shown error
provides the different email as message, stating
correct error configured in the that the password
message saying database of the or email address,
that an invalid system. or both is invalid
email address or
password or both
were entered.
The test is passed if None SSRD CR-03 TC-01-01, TC- VH H Y a. Contributor
a. Contributor 02-01, TC-03-01 registration is
registration is successful and
successful and appropriate
appropriate message stating
message stating that, contributor
that, contributor account will be
account will be approved by
approved by moderator.
moderator, is B. Moderator on
displayed. login can see the
b . Moderator on contributor
login can see the request by
contributor clicking on the
request by clicking Moderator
on the Moderator functions link and
functions link and checking for the
checking for the corresponding
corresponding contributor under
contributor under the Recent
the Recent changes Changes module
module.
The test is passed Contributor SSRD-CR-03 TC-01-01, TC- VH L Y a.
if, submits the same 02-01, TC-03-
a. Contributor email and 01, TC-04-01
Contributor
sees the "Add password as sees the
source", "Add configured in the "Add
Timeline Item" and database of the
"Submit comment" system. source",
links in the "Add
navigation bar. Timeline
b. Contributor sees
the 'Welcome Item" and
Rebecca' message. "Submit
comment"
links in the
navigation
bar.
b.
Contributor
sees the
The test is passed Contributor SSRD- CR-03 TC-01-01, TC- VH L Y Page throws
if the system submits an invalid 02-01, TC-03- error, " email or
provides the email but valid 01, TC-04-01 password invalid"
correct error password.
message saying
that an invalid
email address or
password or both
were entered.
Test is passed if None SSRD-CR-04 TC-01-01, TC- VH VH Y Submission page
a. Submission page 02-01, TC-03- redirects to
redirects to 01, TC-04-01, Homepage and a
Homepage and a TC-05-01 message,
message, "Submission was
"Submission was successful. You
successful. You will will receive an
receive an email email when the
when the source source has been
has been approved approved or
or denied. " is denied. " is
displayed displayed
b. Submission
created in the
system (verifiable
by moderator
logging in and
verifying that the
submission can be
viewed by going to
the moderator
functions link, and
clicking on Recent
changes in the left
rail, and locating
the corresponding
source submission
under Recent
sources.
Test is passed if None SSRD-CR-04 TC-01-01, TC- VH VH Y Submission page
a. Submission page 02-01, TC-03- redirects to
redirects to 01, TC-04-01, Homepage and a
Homepage and a TC-05-01 message,
message, "Submission was
"Submission was successful. You
successful. You will will receive an
receive an email email when the
when the source source has been
has been approved approved or
or denied. " is denied. " is
displayed displayed
b. Submission
created in the
system (verifiable
by moderator
logging in and
showing the
created submission
in the list
submissions page).
On navigating to SSRD- CR-06, TC-01-01, TC- VH M Y On navigating to
the regime a. The date for SSRD-CR-07 02-01, TC-03- the regime
homepage, the which the new 01, TC-04-01, homepage, the
new Regime can regime is TC-05-01, TC- new Regime can
be seen between approved falls 06-01, TC-06-02 be seen between
the dates specified. within the visible the dates
ranges of dates in specified.
the timeline
homepage.
b. The regime
submitted by
contributor for
approval does not
already exist in
the regime
timeline.
On navigating to SSRD- CR-06, TC-01-01, TC- VH M Y On navigating to
the regime a.The date for SSRD-CR-07 02-01, TC-03- the regime
homepage, the which the new 01, TC-04-01, homepage, the
new Regime regime is TC-05-01, TC- new Regime
cannot be seen approved falls 06-01, TC-06-02 cannot be seen
between the dates within the visible between the
specified. ranges of dates in dates specified.
the timeline
homepage.
b. The regime
submitted by
contributor for
approval does not
already exist in
the regime
timeline.
The Event log, the Evalid script gives SSRD-LOS-1 TC-01-01, TC- H VH Y
LoadTest Scenario, error, found null " 02-01, TC-03-
the Script File, and ", which is 01, TC-04-01,
the LoadTest Chart validated as a TC-05-01, TC-
show no valid false positive due 06-01, TC-06-02
errors. to component in
SIMILIE code.
The test is passed All users are SSRD-LOS-02 TC-01-01, TC- Y VH Y Moderator finds
if connected to the 02-01, TC-03- 5 different
a. All contributors internet and have 01, TC-04-01, submissions,
see a message on strong internet TC-05-01, TC- corresponding to
their screen, connections. 06-01, TC-06-02 the 5 different
stating that their contributors exist
submissions have
been received and
they will receive a
confirmatioemail.
b. Moderator on
login can locate
the five
submissions by t
he same users,
who participated in
the test.
The test is passed None SSRD-SR-1 TC-01-01, TC- M VH Y No major
if no major 02-01, TC-03- inconsistency is
inconsistency is 01, TC-04-01, observed
observed between TC-05-01, TC- between the
the desired user 06-01, TC-06-02 desired user
interface and the interface and the
functional behavior functional
of the system on behavior of the
different browsers. system on
b.User interface is different
uniform and easy browsers.
to navigate on
specified browsers,
Firefox 3.0+, IE
7.0+, and Safari
3.0+
Preview page None CR-5 TC-01-01, TC- M M Y Timeline item,
timeline item 02-01, TC-03- (Regime) ,
description 01, TC-04-01, Bibliography of
matches the TC-05-01 Western works
content entered by on early
the contributor medieval, is
visible on the
regime timeline,
to the
contributor, after
submitting the
timeline item,
and a message
stating that the
submission was
successful is
displayed.
User on logging in At least 5 recent CR-8 TC-01-01, TC- M M Y User on logging in
can see 4 recent submissions exist 02-01, TC-03- can see 4 recent
submissions, under in the system, 01, TC-04-01, submissions,
the what’s new before the TC-05-01, TC- under the what’s
link. moderator 06-01, TC-06-02 new link.
downsizes the
number of recent
submissions.
Page shown recent Submissions exist CR- 8 TC-01-01, TC- M M Y Page displays the
updates matches in the system 02-01, TC-03- most recently
most recently matching the 01, TC-04-01, updated data,
updated value set administrator-set TC-05-01, TC- under the What’s
by moderator in most recently 06-01, TC-06- new link,,
09-01 i.e exactly 4. updated 02, TC-09-01 showing up to 4
parameter, which recently updated
is 4 from test 09- submissions
01
Citations page that At least one CR-9 None M M Y Page displays
is displayed has the regime/event/indi citations in
citations sorted by vidual exists in descending order
descending date the timeline, and of date as follows
for this 1. "The bestowal
regime/event/indi of surnames
vidual, there are under the
at least two Western Wei--
citations Northern Chou: a
case of counter-
acculturation,"
T'oung Pao 63:2-
3 (1977):137-77.
2. Biography of
Yu-wen Hu
(translation from
the Zhou Shu).
Berkeley:
University of
California Press,
1962.
3. Accounts of
Western nations
in the history of
the Northern
Chou dynasty.
Berkeley:
University of
California Press,
1959.
Actual
Actual
Testing
Testing
Cost
Cost Rating
(Hours)
0.2 L
0.2 M
0.4 H
0.4 H
0.2 L
0.2 L
0.8 H
0.2 M
0.2 L
1 H
1 VH
0.5 VH
0.5 VH
1 VH
1 VH
1 VH
0.2 M
0.5 VH
0.5 VH
0.5 VH
TC- TC- TC- TC- TC- TC- TC- TC- TC- TC- TC- TC- TC- TC- TC- TC- TC- TC- TC- TC-
01-01 01-02 02-01 02-02 03-01 03-02 04-01 05-01 05-02 06-01 06-02 08-01 08-02 11-01 12-01 13-01 07-01 09-01 09-02 10-01
TC-
01-01
TC-
01-02
TC-
1
02-01
TC-
1 1
02-02
TC-
1 1
03-01
TC-
1 1
03-02
TC-
1 1 1
04-01
TC-
1 1 1 1
05-01
TC-
1 1 1 1
05-02
TC-
1 1 1 1 1
06-01
TC-
1 1 1 1 1
06-02
TC-
1 1 1 1 1 1 1
08-01
TC-
1 1 1 1 1 1 1
11-01
TC-
1 1 1 1 1 1 1
12-01
TC-
1 1 1 1 1 1 1
13-01
TC-
1 1 1 1 1 1 1
07-01
TC-
1 1 1 1 1 1 1
09-01
TC-
1 1 1 1 1 1 1 1
09-02
TC-
10-01
Summary
Pass 19
Fail 0
NA 0
19
Value
Test Value Bug_Prior
Impact Fail? Cost (multiplicati Bug#
Priority (additive) ity
ve)
5 64 2 3.00 2.50 0
5 0 3 2.00 1.67 0 0
5 59 2 3.00 2.50 0 0
3 0 3 0.00 1.00 0 0
5 46 2 3.00 2.50 0 0
5 0 2 3.00 2.50 0 0
5 41 4 1.00 1.25 0 0
5 31 2 3.00 2.50 0 0
5 0 2 3.00 2.50 0 0
5 21 5 0.00 1.00 0 0
5 21 5 0.00 1.00 0 0
5 0 3 2.00 1.67 0 0
4 0 5 -1.00 0.80 0 0
NA 0 5 NA NA 0 0
3 0 5 -2.00 0.60 0 0
3 0 3 0.00 1.00 0 0
3 3 3 0.00 1.00 0 0
3 0 3 0.00 1.00 0 0
3 0 3 0.00 1.00 0 0
NA 0 NA NA NA 0 0
NA 0 NA NA NA 0 0
NA 0 NA NA NA 0 0
NA 0 NA NA NA 0 0
NA 0 NA NA NA 0 0
NA 0 NA NA NA 0 0
Regression test# Date/Time Period
#1 03/24/2010- 03/26/2010
#2
03/29/2010- 03/30/2010
#3
04/23/2010- 04/28/2010
#4
#5
#6
…
Overall assessment of
the software tested: The testing approach was to concurrently test the software on the server and on different browsers.
Impact of test
environment: One Issue in the testing environment, has been the use of eValid for testing TC-11-01. eValid tests ar
Recommended
improvements: To handle this false positive for test case 11-01, we have written to the eValid support forum, and in
Test Order
TC-01-01->TC-01-02->TC-02-01
TC-01-01->TC-01-02->TC-02-01->TC-03-01->TC-03-02->TC-04-01->TC-05-01->TC-05-02->TC-06-01->TC-06-02-
>TC-08-01->TC-08-02->TC-11-01->TC-12-01->TC-13-01->TC-02-02->
TC-01-01->TC-01-02->TC-02-01->TC-03-01->TC-03-02->TC-04-01->TC-05-01->TC-05-02->TC-06-01->TC-06-02-
>TC-08-01->TC-08-02->TC-11-01->TC-12-01->TC-13-01->TC-02-02->TC-07-01-> TC-09-01->TC-09-02->TC-10-01->
ch was to concurrently test the software on the server and on different browsers. The testing process was helpful to catch a large numbe
sting environment, has been the use of eValid for testing TC-11-01. eValid tests are failing on our software components which involve MI
e positive for test case 11-01, we have written to the eValid support forum, and in the mean time are searching for alternative tools to pe
Testing Summary
Passed Failed NA
1 3 12
16 0 0
20 0 0
to catch a large number of bugs which were filed as Bugzilla tickets and the developers were notified of these, and these were fixed by th
nents which involve MITs SIMILIE component. Thus the test fails even when the load on the server is just one, i.e. a single instance of an e
alternative tools to perform the load test.
ese, and these were fixed by the developers before CCD.
ne, i.e. a single instance of an eValid test. This is definitely a false positive, as we are manually able to verify that our system matches the
erify that our system matches the expected behavior of our system requirements. The error thrown by eValid is “ found null “””. We belie
eValid is “ found null “””. We believe that this is because of an AJAX component to the SIMILIE code, which throws an exception when an e
ch throws an exception when an eValid script is run.
For Incident Report, you could record some incidents except the bugs (because you have already reported to bugzilla)that occ
Test Incident ID Input Expected Output Actual Output Impact
lready reported to bugzilla)that occurs during the testing process, and might require the developing team pay attention to
m pay attention to