Technology to Life
Network Systems & Technologies (P) Ltd.
Testing Web Applications
Transforming Ideas to Products
www.nesttech.com / www.n-nest.co.jp NeST, “Periyar”, Technopark, Trivandrum – 695581, India Tel: +91 (471) 2527441 Fax: +91 (471) 2700442
Technology to Life
NeST the company
NeST is an ODM services provider focused on
delivering value by creating
customized solutions addressing the problems of our customers, using appropriate technology and processes, thus forging enduring partnerships
Technology to Life
The NeST Group
Group Activities
Total IT solutions
Hardware R & D
Ontari o
Chantilly, VA Quakertown, PA London Paris Riyadh Dubai
Hardware Manufacturing
Software Development Tech Support Services
Tokyo
Bangalore Cochin Trivandrum
Melbourne
IT Training
2500+ Employees Worldwide
The NeST Group is an international conglomerate offering manufacturing, systems engineering and software
development & support services globally since 1991
Group Business Total IT solutions Hardware R & D Hardware Manufacturing Software Development Tech Support Services IT Training
Technology to Life
NeST Software
• •
Capabilities in multiple domains and technologies Provided software solutions to Fortune 100 clients since 1995
Technology to Life
Quality – The Key to Success
Time tested and certified processes focused on Customer Satisfaction
Technology to Life
NeST Certifications
• CMMI - Level 5 SE/SW/IPPD/SS v 1.1 • CMM Level 5 • ISO-9001 2000
• Clear procedures and practices that blend in customer’s specific requirements • Established V&V Procedures within world wide accepted QA frameworks • Clear communication & confidentiality procedures
Technology to Life
Testing Services
• Concept of Independent Testing Team – Acts as Virtual Customer for NeST projects Reduces cost of testing & increases effectiveness Expert test professionals well versed in test tools & methodologies Provides an independent external analysis of the product that will help uncover “bugs of assumption”
• •
•
Technology to Life
Workflow for External Testing Projects
•
Services Provided Include – Product / package testing – Functionality & Compliance testing – Stress, Load & failure analysis – Interoperability – Coordinating analysis of issues – Coordinating postdelivery support
Technology to Life
Challenges in Web Testing
• One of the key strategic challenges of Web testing is the dominance of change.
– – – – The technology is everchanging; The platform and configuration are ever-changing The business model is ever-changing The customer base and their expectations are everchanging Leads to multiple changes in requirements and User Interface
Technology to Life
Involvement of Testing Team from Initial Stages
• From the inception of the product itself, test engineers work along with developers to explore various user scenarios to which the product might be subjected
Technology to Life
Initial Involvement of Testing Team
• Market study is done to evaluate
– Most common platforms of usage – Performance of similar products in the market
• Targets are set for the final product based on these studies
Technology to Life
Types of Testing
• Functionality testing ensures that all aspects of the site function properly: that objects such as pictures, text, and forms appear correctly, links work, form submissions succeed, etc. Compatibility testing ensures functionality with different browsers and operating systems. Usability testing measures the ease with which a user can accomplish predefined tasks. Stress testing determines the system’s breaking point based on predefined failure criteria. Load testing generates user traffic on the Web site to determine if the site is capable of handling a predetermined peak load. Concurrency testing is used to test behavior when more than one user is using same resource at the same time
• • • • •
Technology to Life
Testing – Case Study
• The Product • A one point Management Information System of a multinational organization • Integrating
– HR database – Asset Management System – Financial System – Help Desk System – Tracking of all the project related activities starting from lead creation to project closure.
• • • •
Challenges Changing requirements Frequent builds 21000 Test cases to be run against each build • Ensure Complete and Efficient Testing against each build • Ensure Performance , Load and Stress testing • Security testing
Technology to Life
Testing Activities
• • Functionality Testing against the Product Specification Checklists for developed for prevention and verification of
– Common web application defects – User Interface Usability
•
• •
• • • •
Compliance testing with user manual and online help was done to ensure adequacy and completeness of user manual and online help Stress Testing using CPU Load tool. Security Testing – Since system contains critical and confidential data, various user privileges tested Performance Testing Volume Testing using Rational Robot Regression Testing to ensure that new features have not caused any bug in existing-base modules are automated Automation using Rational Robot Concurrency Testing to ensure that more than one user using a particular feature at the same time does not cause any issues
Technology to Life
Tools Usage
• Rational Robot
– For automation – For generating test data in bulk
• CPUload
– a tool to generate load on the CPU
• Performance Monitor
– A tool to check performance of the product
• Norton Ghost
– A tool used to create images of existing systems inorder to save installation time for future builds
Technology to Life
Effective Usage of an Automation Tool -Test cases generation
• Scenario
– Some highly confidential data also present in the product along with public data – User privilege and privilage based permissions highly critical – Two levels of permissions
• Role Based
– Scope based – Allocation based
• Privilage Based
– A total of 1000 test cases expected
• Solution • Test case generation automated using Test Script Language
Technology to Life
Effective Usage of an Automation Tool -Test data generation
• Scenario
– Product requires a huge amount of data in the system for effective testing – Each release is a tested on a fresh server;hence all previous data is lost – Manual addition of data will consume a lot of precious testing days
• Solution • Test data is populated effectively using Rational Robot and Rational Test Manager • Adding 10,000 leads into the system • Manually : 337hours • Using tool : 5 hours
Technology to Life
Load Testing ROI
• For Load, stress and performace testing using 250 users
– Manually : 1790 hours~224 MD effort – Effective usage of tools : 34 hours~4.25 MD effort
Technology to Life
Test Analysis
• Test result analysis
Cumulative No. Bugs
– Metrics of test cases executed to find out test coverage – Analysis of open bugs
Bug Trend Curve
200 150 100
LLEst Est Defect ULEst
50 5 No. Days of Testing 10
• Bug Trend Analysis
No. defects found
0 Test Cases Defect Analysis 0
19 16
functionali ty
Interface
linguiestic errors
checking/ validation
formating errors
Logic
others
Suggestio n
Defect causes
data handling
29 – Rate of 50 bug capture 40 26 30 20diagrams Ishikawa100 in testing – Inadequacy – Stability of product
45
8
8
3
2
Technology to Life
Test Certification
• Product certification
– Certification Criteria for product is defined upfront. – If the criteria for certifying the product is met, product is certified
Technology to Life
Testing – The NeST Philosophy
Driving test team motivation
Technology to Life
Testing – Why NeST
• Domains
– Automation Systems – Embedded & System solutions – Medical & pharma equipment – Communication & networking systems
• Advantages
– Fast ramp up to technology,
standards and special requirements – Good development capability ensures quality & efficient test applications – Teams with cross disciplinary experience – Practices and
• Expertise
– Independent testing team with more than 350 manyears of core testing skills – Has extensive experience testing for highly demanding customers – Well defined and strictly enforced test procedures
methodologies that blend in
the best from some of the best known technology companies
Technology to Life
Thank You