Test Management Tools Review by pharmphresh24

VIEWS: 1,371 PAGES: 5

									             Test Management Tools Review
             Narayanan Palani, Student in Computer Applications, BITS- Pilani, India.
                    Wipro Technologies, Electronics City, Bangalore, India.
                   [Tel:+91-9900465054 E-mail: narayananp24@gmail.com]

Abstract:                                            D. Wip-CAFE TMS:

Test management is the activity of managing          (Wipro’s Common Automation Framework for
some tests. A test management tool is a              the Enterprise-Test Management Suite)
Software used by Quality Assurance team to           It covers all the aspects of test management
manage the tests (automatic or not) that have        activity as a unique tool. It can be used for
been previously specified. This paper reviews        manual and automation test projects.
various functionalities to manage tests.
                                                               II. REQUIREMENTS IN TEST
Tools compared: Quality Center 9.2, Rational                       MANAGEMENT TOOLS:
Test Manager 7.1 and Silk Central Test
Manager 2008, Wip-CAFÉ TMS                           A. Requirements Module in Quality Center:

                                                     It enables organizations to share a common
                 I. INTRODUCTION:                    vision for requirements management. Quality
                                                     Center not only provides a centralized storage
A. Quality Center:                                   area for requirements but allows you to track
                                                     their progress through the application life
Quality Center (formerly Test Director) is a web     cycle. Requirements are linked to the
based test management tool developed by              execution results of tests so user can easily see
Mercury Interactive Corporation. Quality Center      if a requirement has been satisfied or not.
helps to organize and manage all phases of the
application testing process viz., specifying
testing requirements, planning test cases,
executing tests, and tracking defects.

B. Rational Test Manager:
                                                     Figure 1: Requirements Module in Quality
The Rational Test Manager provides control,
management and reporting of all test activities
from a single, central point.
                                                     B. Requirements management in Rational Test
C. Silk Central Test Manager:
                                                     Rational     Test    Manager      can    retrieve
It delivers a complete testing solution, from
                                                     Requirements (as Test Inputs) from,
requirements and test plan management, to test
                                                     1. Values in a Microsoft Excel Spreadsheet
execution management, code coverage analysis,
                                                     2. Requirements in a Rational RequisitePro
issue tracking and reporting. It allows you to
utilize existing Silk Test and Silk Performer
                                                     3. Elements in a Rational Rose visual model
scripts and creates scheduled tests based on those
scripts. In a few simple steps your test cases can
                                                     C. Requirements management in Silk Central
be run automatically based on individually
                                                     Test Manager:
configurable schedules.
It provides two methods for capturing                  D. Test Plan in Wip-CAFÉ TMS:
requirements by, Importing requirements from
MS Word/MS Excel and Entering requirements             In Test Plan you can create test plans in various
directly via the Test Manager GUI.                     folders in tree level. You can specify plan type,
                                                       Round of testing like system testing, Integration
                                                       testing or User acceptance testing. You can
                                                       allocate test cases to selected test plans using
Figure 2: Requirements in SCTM                         Wip-CAFÉ TMS. It facilitates user to track all
                                                       the testing activities of the respective test plan.
D. Requirements management in Wip-CAFÉ

In the requirement module of Wip-CAFÉ, user
can capture the technical requirements of an
automation project and also create/upload
manual test cases that are input for automation.

                                                       Figure 5: Test Plan in Wip-CAFÉ TMS

                                                          IV. SCRIPTS MANAGEMENT IN TEST
                                                              MANAGEMENT TOOLS:
Figure 3: Requirements in Wip-CAFÉ
                                                       A. Scripts Management in Quality Center:
                                                       The scripted components can also be used along
                                                       the business components if required. The steps of
                                                       the Scripted component can be described in the
A. Test Plan in Quality Center:
                                                       Quality Centre where as the coding can be done
                                                       in QTP.
The Test Plan module you divide your
application into units, or subjects, by creating a
test plan tree. This is a graphical representation
of your test plan, displaying your tests according
to the hierarchical relationship of their functions.

                                                       Figure 6: Scripts tree view in Quality Center

                                                       B. Scripts    Management      in   Rational     Test
Figure 4: Test Plan in Quality Center                  Manager:

B. Test Plan in Rational Test Manager:                 You can manage scripts in Test Scripts Window.
A test plan can be created stand-alone, i.e.           Each test script type contains the test script
without reference to test inputs, or starting with     source, which contains test scripts.
test inputs and creating test cases for each input.

C. Test Plan in Silk Central Test Manager:

In Test Plan you can begin planning how you
will test the requirements over the course of
development process.
                                                     To add a test case you should define a test and
                                                     design test steps under it. After you add a test to
                                                     the test plan tree and define basic test
                                                     information, you define test steps—detailed,
                                                     step-by-step instructions that specify how to
                                                     execute the test.

Figure 7: Scripts in RTM                             Figure 9: Test Steps in QC
C. Script Management in Silk Central Test            B. Test Cases/Test Steps in Rational Test
Manager:                                             Manager:
While Adding Test Definition to Test Plan you
can add test scripts to the respective Test Steps.   The test plan is centered on test cases. After you
                                                     identify your test inputs and decide what you
                                                     plan to test, you can create your test cases.

                                                     C. Test Cases/Test Steps in Silk Central Test

                                                     While adding Test Definition user can select Test
Figure 13: Test Plan View in SCTM                    case. In the field titled Test script you can see the
                                                     name of the test script that you selected. The
D.Script Management in Wip-CAFÉ TMS:                 next field, named Test case, lists all available test
                                                     cases from the selected script.
In Wip-CAFÉ you can design scripts using
“Design module”. In this module you can create
the design model. You can create libraries,
components, parameters for components;
perform parameter linking for each parameter.
For each component you can save the scripts.

                                                     Figure 10: Test Case in SCTM

                                                     D. Test Cases/Test Steps in Wip-CAFÉ TMS:

                                                     It facilitates user to create test cases in templates
Figure 8: Components and Parameter Linking in        created/modified by user. You can create your
Wip-CAFÉ                                             own template for test cases creation.


A. Test Cases/Test Steps in Quality Center:
                                                     Figure 11: Create custom templates to create test
                                                        • Schedule execution definitions
                                                        • Create issues for test definitions from the
           VI. EXECUTION IN TEST                       Execution unit
              MANAGEMENT TOOLS
                                                       D. Execution in Wip-CAFÉ TMS:
A. Execution in Quality Center:
                                                       You can execute through “Work Area” menu for
                                                       manual test cases. You can execute using various
You start execution by creating test sets and          tools for ‘Automation Projects’ like QTP,RFT
choosing which tests to include in each set.           etc.
A test set is a group of tests in a Quality Center
project designed to achieve specific testing goals.
Quality Center enables you to control the
execution of tests in a test set by setting
conditions and scheduling the date and time for
executing your tests.

                                                       Figure 14: Execution in Wip-CAFÉ.

                                                                VII. DEFECT TRACKING IN TEST
                                                                      MANAGEMENT TOOLS:

                                                       In Quality Center defects tracked through these
                                                       stages: New, Open, Fixed, and Closed. A defect
Figure 12: Running the Test Manually in QC             may also be rejected or it may be reopened after
                                                       it is fixed. In Rational Test Manager it
B. Execution in Rational Test Manager:                 automatically fills in some of the fields in the
                                                       ClearQuest defect form with information from
When you run a test, you run the implementation        the test log and automatically records the defect
of each test case to validate the specific behavior    ID from ClearQuest in the test log. In Wip-
passes the quality standards of that test case. Test   CAFÉ TMS you can add defects in “BugBrick”
cases validate that the system is working the way      menu. Three major roles can add/update roles
that it is supposed to work and is built with the      like Tester, Manager and Developer. So defect
quality needed.                                        tracking activity is formulated in a flexible flow.

                                                        VIII. REPORTS IN TEST MANAGEMENT TOOLS:

                                                       In Quality Center you can create a report from
                                                       the Requirements, Test Plan, Test Lab, and
                                                       Defects modules. Rational Test Manager
                                                       provides Test case reports, Performance testing
                                                       reports and Listing reports. SilkCentral Test
                                                       Manager provides reports like Requirements
    Figure 13: Running Tests Manually in RTM.          Coverage. Wip-CAFÉ TMS provides reports as
                                                       functional and automation reports.
C. Execution in Silk Central Test Manager:

Steps involved in execution process in this tool:
  • Create an execution definition
  • Link your test definitions to execution
  • Immediately run an execution definition
               IX. BRIEF ANALYSIS:                          functionalities review over various test
                                                            management tools. It gives a brief picture to
Tool          Strength                   Weakness           select a flexible test management tool for our
Quality       Possibly the most          No Java            software testing projects.
              popular test tool,         support out the
              Good support, Good         box, More
              online community,          expensive          [1]QualityCenter:https://h10078.www1.hp.com/c
              Good cross browser         solution           da/hpms/display/main/hpms_content.jsp?zn=bto
              support.                                      [2]Rational        Test     Manager:http://www-
Rational      Economical, Lots of        Scripting          [3]SilkCentral                              Test
Test                                                        Manager:http://www.borland.com/us/products/sil
              supporting tools,          language is a
Manager                                                     k/silkcentral_test/index.html
              Good extensible            little basic out   [4]Wip-CAFÉ
              scripting language         the box and a      TMS:http://www.wipro.com/testing/point_soluti
              through VB, Good           bit confusing      ons_frameworks/wip_cafe.htm
              data creation              with tools.
              facilities, Good
              online community.

SilkCentral   Built-in        recovery   Expensive, No
Test                                     object identity
              system               for
Manager                                  tool available.
              unattended testing.
              Ability to test across
              multiple    platforms,
              browser              and
              technologies in one

Wip-CAFÉ      Customized                 No        object
TMS           templates for test         identity    tool
              specifications    and      available,
              test            cases,     Some
              Traceability between       limitations in
              specifications,   test     script    usage
              cases and defects,         for
              Tools support, Script      automation.
              design management.

                   X. CONCLUSION:

End-to-end management of the testing lifecycle
in the test department including resources,
releases and test cases, scheduling, test execution,
defects, documents, collaboration and all aspects
of reporting and metrics in real-time are major
areas in test management. This paper sketches

To top