Get documents about "Test Management Tools Review
Document Sample
Test Management Tools Review
Narayanan Palani, Student in Computer Applications, BITS- Pilani, India.
Wipro Technologies, Electronics City, Bangalore, India.
[Tel:+91-9900465054 E-mail: narayananp24@gmail.com]
Abstract: D. Wip-CAFE TMS:
Test management is the activity of managing (Wipro’s Common Automation Framework for
some tests. A test management tool is a the Enterprise-Test Management Suite)
Software used by Quality Assurance team to It covers all the aspects of test management
manage the tests (automatic or not) that have activity as a unique tool. It can be used for
been previously specified. This paper reviews manual and automation test projects.
various functionalities to manage tests.
II. REQUIREMENTS IN TEST
Tools compared: Quality Center 9.2, Rational MANAGEMENT TOOLS:
Test Manager 7.1 and Silk Central Test
Manager 2008, Wip-CAFÉ TMS A. Requirements Module in Quality Center:
It enables organizations to share a common
I. INTRODUCTION: vision for requirements management. Quality
Center not only provides a centralized storage
A. Quality Center: area for requirements but allows you to track
their progress through the application life
Quality Center (formerly Test Director) is a web cycle. Requirements are linked to the
based test management tool developed by execution results of tests so user can easily see
Mercury Interactive Corporation. Quality Center if a requirement has been satisfied or not.
helps to organize and manage all phases of the
application testing process viz., specifying
testing requirements, planning test cases,
executing tests, and tracking defects.
B. Rational Test Manager:
Figure 1: Requirements Module in Quality
The Rational Test Manager provides control,
Center
management and reporting of all test activities
from a single, central point.
B. Requirements management in Rational Test
Manager:
C. Silk Central Test Manager:
Rational Test Manager can retrieve
It delivers a complete testing solution, from
Requirements (as Test Inputs) from,
requirements and test plan management, to test
1. Values in a Microsoft Excel Spreadsheet
execution management, code coverage analysis,
2. Requirements in a Rational RequisitePro
issue tracking and reporting. It allows you to
project
utilize existing Silk Test and Silk Performer
3. Elements in a Rational Rose visual model
scripts and creates scheduled tests based on those
scripts. In a few simple steps your test cases can
C. Requirements management in Silk Central
be run automatically based on individually
Test Manager:
configurable schedules.
It provides two methods for capturing D. Test Plan in Wip-CAFÉ TMS:
requirements by, Importing requirements from
MS Word/MS Excel and Entering requirements In Test Plan you can create test plans in various
directly via the Test Manager GUI. folders in tree level. You can specify plan type,
Round of testing like system testing, Integration
testing or User acceptance testing. You can
allocate test cases to selected test plans using
Figure 2: Requirements in SCTM Wip-CAFÉ TMS. It facilitates user to track all
the testing activities of the respective test plan.
D. Requirements management in Wip-CAFÉ
TMS:
In the requirement module of Wip-CAFÉ, user
can capture the technical requirements of an
automation project and also create/upload
manual test cases that are input for automation.
Figure 5: Test Plan in Wip-CAFÉ TMS
IV. SCRIPTS MANAGEMENT IN TEST
MANAGEMENT TOOLS:
Figure 3: Requirements in Wip-CAFÉ
A. Scripts Management in Quality Center:
III. TEST PLANS IN TEST MANAGEMENT
The scripted components can also be used along
TOOLS
the business components if required. The steps of
the Scripted component can be described in the
A. Test Plan in Quality Center:
Quality Centre where as the coding can be done
in QTP.
The Test Plan module you divide your
application into units, or subjects, by creating a
test plan tree. This is a graphical representation
of your test plan, displaying your tests according
to the hierarchical relationship of their functions.
Figure 6: Scripts tree view in Quality Center
B. Scripts Management in Rational Test
Figure 4: Test Plan in Quality Center Manager:
B. Test Plan in Rational Test Manager: You can manage scripts in Test Scripts Window.
A test plan can be created stand-alone, i.e. Each test script type contains the test script
without reference to test inputs, or starting with source, which contains test scripts.
test inputs and creating test cases for each input.
C. Test Plan in Silk Central Test Manager:
In Test Plan you can begin planning how you
will test the requirements over the course of
development process.
To add a test case you should define a test and
design test steps under it. After you add a test to
the test plan tree and define basic test
information, you define test steps—detailed,
step-by-step instructions that specify how to
execute the test.
Figure 7: Scripts in RTM Figure 9: Test Steps in QC
C. Script Management in Silk Central Test B. Test Cases/Test Steps in Rational Test
Manager: Manager:
While Adding Test Definition to Test Plan you
can add test scripts to the respective Test Steps. The test plan is centered on test cases. After you
identify your test inputs and decide what you
plan to test, you can create your test cases.
C. Test Cases/Test Steps in Silk Central Test
Manager:
While adding Test Definition user can select Test
Figure 13: Test Plan View in SCTM case. In the field titled Test script you can see the
name of the test script that you selected. The
D.Script Management in Wip-CAFÉ TMS: next field, named Test case, lists all available test
cases from the selected script.
In Wip-CAFÉ you can design scripts using
“Design module”. In this module you can create
the design model. You can create libraries,
components, parameters for components;
perform parameter linking for each parameter.
For each component you can save the scripts.
Figure 10: Test Case in SCTM
D. Test Cases/Test Steps in Wip-CAFÉ TMS:
It facilitates user to create test cases in templates
Figure 8: Components and Parameter Linking in created/modified by user. You can create your
Wip-CAFÉ own template for test cases creation.
V. TEST CASES/TEST STEPS MANAGEMENT
IN TEST MANAGEMENT TOOLS:
A. Test Cases/Test Steps in Quality Center:
Figure 11: Create custom templates to create test
cases.
• Schedule execution definitions
• Create issues for test definitions from the
VI. EXECUTION IN TEST Execution unit
MANAGEMENT TOOLS
D. Execution in Wip-CAFÉ TMS:
A. Execution in Quality Center:
You can execute through “Work Area” menu for
manual test cases. You can execute using various
You start execution by creating test sets and tools for ‘Automation Projects’ like QTP,RFT
choosing which tests to include in each set. etc.
A test set is a group of tests in a Quality Center
project designed to achieve specific testing goals.
Quality Center enables you to control the
execution of tests in a test set by setting
conditions and scheduling the date and time for
executing your tests.
Figure 14: Execution in Wip-CAFÉ.
VII. DEFECT TRACKING IN TEST
MANAGEMENT TOOLS:
In Quality Center defects tracked through these
stages: New, Open, Fixed, and Closed. A defect
Figure 12: Running the Test Manually in QC may also be rejected or it may be reopened after
it is fixed. In Rational Test Manager it
B. Execution in Rational Test Manager: automatically fills in some of the fields in the
ClearQuest defect form with information from
When you run a test, you run the implementation the test log and automatically records the defect
of each test case to validate the specific behavior ID from ClearQuest in the test log. In Wip-
passes the quality standards of that test case. Test CAFÉ TMS you can add defects in “BugBrick”
cases validate that the system is working the way menu. Three major roles can add/update roles
that it is supposed to work and is built with the like Tester, Manager and Developer. So defect
quality needed. tracking activity is formulated in a flexible flow.
VIII. REPORTS IN TEST MANAGEMENT TOOLS:
In Quality Center you can create a report from
the Requirements, Test Plan, Test Lab, and
Defects modules. Rational Test Manager
provides Test case reports, Performance testing
reports and Listing reports. SilkCentral Test
Manager provides reports like Requirements
Figure 13: Running Tests Manually in RTM. Coverage. Wip-CAFÉ TMS provides reports as
functional and automation reports.
C. Execution in Silk Central Test Manager:
Steps involved in execution process in this tool:
• Create an execution definition
• Link your test definitions to execution
definitions
• Immediately run an execution definition
IX. BRIEF ANALYSIS: functionalities review over various test
management tools. It gives a brief picture to
Tool Strength Weakness select a flexible test management tool for our
Quality Possibly the most No Java software testing projects.
Center
popular test tool, support out the
REFERENCES:
Good support, Good box, More
online community, expensive [1]QualityCenter:https://h10078.www1.hp.com/c
Good cross browser solution da/hpms/display/main/hpms_content.jsp?zn=bto
&cp=1-11-127-24%5E1131_4000_100__
support. [2]Rational Test Manager:http://www-
01.ibm.com/software/awdtools/test/manager/
Rational Economical, Lots of Scripting [3]SilkCentral Test
Test Manager:http://www.borland.com/us/products/sil
supporting tools, language is a
Manager k/silkcentral_test/index.html
Good extensible little basic out [4]Wip-CAFÉ
scripting language the box and a TMS:http://www.wipro.com/testing/point_soluti
through VB, Good bit confusing ons_frameworks/wip_cafe.htm
data creation with tools.
facilities, Good
online community.
SilkCentral Built-in recovery Expensive, No
Test object identity
system for
Manager tool available.
unattended testing.
Ability to test across
multiple platforms,
browser and
technologies in one
script.
Wip-CAFÉ Customized No object
TMS templates for test identity tool
specifications and available,
test cases, Some
Traceability between limitations in
specifications, test script usage
cases and defects, for
Tools support, Script automation.
design management.
X. CONCLUSION:
End-to-end management of the testing lifecycle
in the test department including resources,
releases and test cases, scheduling, test execution,
defects, documents, collaboration and all aspects
of reporting and metrics in real-time are major
areas in test management. This paper sketches
Related docs
