SOA for Hierarchical GUI Test Case Generation Using Automated

Document Sample
SOA for Hierarchical GUI Test Case Generation Using Automated  Powered By Docstoc
					SOA for Hierarchical GUI Test Case Generation
         Using Automated Planning.

by Atif M. Memon, Martha E. Pollack, and Mary
                 Lou Soffa.


            Presented by Bob Mazzi
                    9/30/08
GUIs – Older than you think

• First GUIs – Xerox PARC 1981
• Windows GUIs 1985 – Present
  – 85-94 Installed within DOS
  – 95 – Present True Standalone OS
• Apple GUIs 1984 – Present
• IBM OS/2 1987 – 2006 ( RIP )
                                                State of the Art
GUI = Graphic User Interfaces
                                                                                                              M.M Kaddah “ Interactive
                                                                                                          Scenarios for the development of
                                                           GUI Design                                      a Unser Interface Prototype” 93




                  B.A. Meyers “Why are Human-            D. Rosenberg “User Interface       R.M. Mulligan, M.W. Altom,          J. Nielson “Iterative
                  Computer Interfaces Difficult to        Prototyping in the 90’s” 93       D.K. Simkin “User Interface        User Interface Design”
                   design and Implement?” 7/93                                                     Design…” 91                          11/93


                                                                            A. Kaster “User Interface
                                                                                 Design…” 91                                              General Test
                                                                                                                                         Processes See
                      GUI Tools
                                                                                                                                             Slide 4
                                                         B.A. Meyers “User             M.G. El-Said, G. Fischer, S.A
                                                     Interface Software Tools”      Gamalei-Din, M Zaki “ADDI A Tool
                                                                95                  for Automating the design of visual
                                                                                                                                  Planning of Testing
     GUI Testing                                                                              Interfaces” 97
                                                                                                                                     See Slide 5

                       A. Howe etal “Test Case            A. Walworth            L. The “Stress         L.R. Kepple “The
                     Generation as an AI Planning          “Java GUI              Tests for GUI         Black Art of GUI
                             Problem” 97                  Testing” 98            Programs” 9/92           Testing” 2/94
                                                                                                                                      This Paper
                                                                                                                                      April 2000
   M.L. Hammontree etal “         L. White “Regression         D.J. Kasik, H.G. George “Toward
Integrated Data capture and       Testing of GUI Event       Automatic Generation of Novice User
 Analysis Tools for research       Interactions” 11/96                 test scripts” 4/96
   and testing a GUI” 5/92
                                                                                                                                   Subsequent Work
State of the Art / General Testing

                   T.S. Chow “Testing Software Design Modeled by
                                                                       S. Esmelioglu etal “Automated Test case
                            Finite-State Machines” ” 3/78
                                                                       Generation Planning and Reporting” 10/97




         P.J. Bernhard “A Reduced Test Suite for Protocol                   J.M. Clarke “Automated Test Generation from a
                    Performance testing” 7/94                                           Behavioral Model” 5/98




H. Cho etal “Redundancy Identification/Removal and                                    R.K. Shehady etal“A method to Automate User
   Test Generation for Sequential circuits…” 7/93                                              Interface Testing …” 6/97




                                                            General Test
                                                            Processes.
                                                             to Slide 3
State of the Art / Test Planning
                  M. Peot, D. Smith “Conditional Nonlinear Planning”   D.S. Weld “An introduction to Least Commitment
                                        6/92                                             Planning” 94
                                                                       D.S. Weld “Recent Advances in AI Planning” 99




            K. Erol et al “HTN Planning: Complexity and                         A.L. Blum, M.L. Furst “Fast Planning through
                           Expressivity” 8/94                                           Planning Graph Analysis” 97




 J. Koehler etal “Extending Planning Graphs to the                                     H. Kautz, B. Selman “ The Role of Domain Specific
                   ADL Subset” 97                                                          Knowledge in the planning as Satisfiability
                                                                                                        Framework” 98




                                                          Test Planning
                                                           Processes.
                                                            To Slide 3
                  Overall Timeline
•   1981 Early GUI Precursors ( Xerox / PARC )
•   1983 First Apple GUI ( Lisa )
•   1985 First Microsoft GUI ( Win 1.0 )
•   1987 First IBM GUI ( OS/2 )
•   1978-97 – General topic of “Testing” papers
•   1991-93 – GUI Design papers
•   1992-98 – GUI Testing papers
•   1995-97 – GUI Tools papers
•   1999 – This paper
                                       Related Work
•   Atif M. Memon
     –   6 Papers with M. Pollack and M.L. Soffa
     –   1 Paper with M.L. Soffa
     –   4 papers with Adithya Nagarajan
     –   3 papers with Ishan Banerjee
     –   3 Papers with Xun Yuan
     –   3 Papers with Jaymie Strecker
     –   3 papers with Qing Xie
     –   2 papers with Scott McMaster

•   Martha E. Pollack
     –   6 Common papers, no other related papers

•   Mary Lou Soffa
     –   7 Common papers, no other related papers

•   Adithya Nagarajan & Ishan Banerjee
     –   3/4 Common papers, no other related papers

•   Xun Yuan
     –   3 Common papers, no other related papers

•   Jaymie Strecker
     –   3 Common papers, no other related papers

•   Qing Xie
     –   3 Common papers, One other related paper?

•   Scott McMaster
     –   2 Common papers, no other related papers
           Subsequent Related Work by Atif Memon
•   Atif Memon's Publications
•   2009
•   “Using Reverse Engineering for Automated Usability Evaluation of GUI-Based Applications” by Atif M. Memon.
•   “Testing Graphical User Interfaces” by Jaymie Strecker and Atif M. Memon.
    2008
•   “Using a Pilot Study to Derive a GUI Model for Automated Testing ” by Qing Xie and Atif M. Memon.
•   “Test Case Generator for GUITAR” by Daniel Hackner and Atif M. Memon.
•   “Relationships Between Test Suites, Faults, and Fault Detection in GUI Testing” by Jaymie Strecker and Atif M. Memon.
•    “Call-Stack Coverage for GUI Test-Suite Reduction ” by Scott McMaster and Atif M. Memon.
•   “Automatically Repairing Event Sequence-Based GUI Test Suites for Regression Testing”
    by Atif M. Memon.
•   “Alternating GUI Test Generation and Execution” by Xun Yuan and Atif M. Memon.

•   2007
•    “Fault Detection Probability Analysis for Coverage-Based Test Suite Reduction” by Scott McMaster and Atif M. Memon.
•    “Designing and comparing automated test oracles for GUI-based software applications” by Qing Xie and Atif M. Memon.
•   “Covering Array Sampling of Input Event Sequences for Automated GUI Testing” by Xun Yuan, Myra Cohen. And Atif M. Memon,
•   “Automated GUI Testing Guided by Usage Profiles” by Penelope Brooks and Atif M. Memon.
•   “An event-flow model of GUI-based applications for testing” by Atif M. Memon.
•    “Agile Quality Assurance Techniques for GUI-Based Applications” by Qing Xie and Atif M. Memon.
•    “Faults' Context Matters” by Jaymie Strecker and Atif M. Memon.
•   “Using GUI Run-Time State as Feedback to Generate Test Cases” by Xun Yuan and Atif M. Memon.

•   2006
•   “Model-Based Testing of Community-Driven Open-Source GUI Applications” by Qing Xie and Atif M. Memon.
•   “Employing user profiles to test a new version of a GUI component in its context of use” by Atif M. Memon.
•   “Studying the Characteristics of a `Good' GUI Test Suite” by Qing Xie and Atif M. Memon.
•   “Call Stack Coverage for GUI Test-Suite Reduction” by Scott McMaster and Atif M. Memon.
•   “Techniques and processes for improving the quality and performance of open-source software”
    by Adam Porter, Cemal Yilmaz.

•   2005
•   “Studying the Fault-Detection Effectiveness of GUI Test Cases for Rapidly Evolving Software” by Atif M. Memon and Qing Xie.
•   “Rapid "Crash Testing" for Continuously Evolving GUI-Based Software Applications” by Qing Xie and Atif M. Memon.
•    “Call Stack Coverage for Test Suite Reduction” by Scott McMaster and Atif M. Memon.
•    “Automating regression testing for evolving GUI software” by Atif Memon, Adithya Nagarajan, and Qing Xie.
                     Subsequent Related Work by Atif Memon
•   2004
•    “Empirical Evaluation of the Fault-Detection Effectiveness of Smoke Regression Test Cases for GUI-Based Software” by Atif M. Memon and
    Qing Xie.
•   “Automated GUI Regression Testing Using AI Planning” by Atif M. Memon.
•    “A Distributed Continuous Quality Assurance Process to Manage Variability in Performance-intensive Software” by Arvind S. Krishna, Cemal
    Yilmaz. Atif M. Memon, Adam Porter, Douglas C. Schmidt, Aniruddha Gokhale, and Balachandran Natarajan,
•    “Using Tasks to Automate Regression Testing of GUIs” by Atif M. Memon.


•   2003
•   “Regression testing of GUIs” by Atif M. Memon and Mary Lou Soffa.
•   “Advances in GUI Testing” by Atif M. Memon.
•    “What Test Oracle Should I Use for Effective GUI Testing?” by Atif M. Memon, Ishan Banerjee, and Adithya Nagarajan.
•   “DART: A Framework for Regression Testing Nightly/daily Builds of GUI Applications” by Atif M. Memon, Ishan Banerjee, and Adithya Nagarajan.
•   “ Automatically Testing “Nightly/daily Builds” of GUI Applications” by Atif M. Memon, Ishan Banerjee, and Adithya Nagarajan.

•   2002
•   “GUI Testing: Pitfalls and Process” by Atif M. Memon.

•   2001
•   “Hierarchical GUI Test Case Generation Using Automated Planning” by Atif M. Memon, Martha E. Pollack, and Mary Lou Soffa. ( This paper )
•   “Coverage criteria for GUI testing” by Atif M. Memon, Mary Lou Soffa, and Martha E. Pollack.

•   “A comprehensive framework for testing graphical user interfaces” by Atif M. Memon.
    Ph.D. dissertation, 2001. Advisors: Mary Lou Soffa and Martha Pollack; Committee members: Prof. Rajiv Gupta (University of Arizona), Prof. Adele E.
    Howe (Colorado State University), Prof. Lori Pollock (University of Delaware) .


•   2000
•    “Automated test oracles for GUIs” by Atif M. Memon, Martha E. Pollack, and Mary Lou Soffa.
•   “A Planning-Based Approach to GUI Testing” by Atif M. Memon, Martha E. Pollack, and Mary Lou Soffa.
•   “Plan Generation for GUI Testing” by Atif M. Memon, Martha E. Pollack, and Mary Lou Soffa.


•   1999
•   “Using a goal-driven approach to generate test cases for GUIs” by Atif M. Memon, Martha E. Pollack, and Mary Lou Soffa.

				
DOCUMENT INFO
Shared By:
Categories:
Tags:
Stats:
views:2
posted:9/8/2012
language:English
pages:9