Direction sign by HC12091815472

VIEWS: 0 PAGES: 34

									Quality Analysis Report
Quality Assurance Activities Summary




                        http://code.google.com/p/isec-deis-mis-ds-ps-group1/
                        2008/2009 IPC ISEC-DEIS
    Summary

•    Trinity
•    Quality Roadmap
      –   Quality Vision
      –   Quality Actions
      –   Quality Metrics
•    Quality Assurance Activities
•    Change Control Activities
•    Network Knowledge
•    Survey
•    Lessons Learned
3 Master Plan
Trinity
Quality Vision
Quality Roadmap


  Qualitative                      Quantitative



  Software is develped right the   Conformance to correct
  first time as much as possible   requirements



  User Satisfaction




  Internal Value
Quality Actions
Quality Roadmap


                   Metrics

           Test Campaign

     Templates; Guidelines

                             Inspection Activities

                             Review Activities

                             Walkthrough Activities
Quality Metrics
Quality Roadmap

   Number of quality activities conducted
   Number of changes to project schedule and
    milestones
   Number of tests by requirement
   Number of tests failed and passed
   Change Request Impact
   Network Knowledge
   Lessons Learned
   Self Evaluation
Quality Assurance Activities
                        Quality Analysis Report




       http://code.google.com/p/isec-deis-mis-ds-ps-group1/
       2008/2009 IPC ISEC-DEIS
QAA Coverage
Quality Assurance Activities
   Document   Quality Activity   Notes
   RA         N.A.               Due to its specificity it was included in the global results
   PI         walkthrough        -
   SDP        review             After a review, it was decided by the author to conduce a walkthrough
   SDP        walkthrough        -

   PAR        N.A.               This document will be closed after QAR. So, it was excluded from the metrics collects. Although, it will
                                 be under walkthrough
   QAP        walkthrough        Walkthrough, but was conduced before the processes and the document it self are agreed.

   QAP        review


   QAR        N.A.               It refers to this document. Because this document refers to the metrics it self, it was excluded from
                                 statistics and analysis. Although, it will be under walkthrough

   CCP        review             -
   CSD        walkthrough        -
   UIP        walkthrough        -
   UR         review             -
   SRS        inspection-doc     -
   SA         review             -
   TCP        review             -
   ITS        review             -
   ATS        review             -
   UIR        walkthrough        -
   ATR        walkthrough        -
   UM         walkthrough        -
   Code1      N.A.               This code was under test campaign
   Code2      inspection-code    -
General Statistics
Quality Assurance Activities

     General Statistics                           #
     Total minor defects found in eighteen (18)
                                                  896
     documents
     Total major defects found in eighteen (18)
                                                  12
     documents
     Average of Nº defects found by document      49.8
     Nº of pages under review                     306
     Nº of defects found by page                  2.9
     Work time in documents                       267 hours
     Work time in document reviews                128 hours
     Nº of Walkthroughs                           8
     Nº of Reviews                                8
     Nº of Inspections                            2
Quality Assurance Meetings
Quality Assurance Activities



                               25%




           75%
Cost in hours of QAA
Quality Assurance Activities


                   10%




                               90%
Total nº defects by doc &
nº defects by document
Quality Assurance Activities
                       560.00




      193.00
                                        138.00138.00

                                70.00
               24.13
                                                           5.00 5.00

      walkthrough         review        inspection-doc   inspection-code
Nº Defects by doc &
by hour review
Quality Assurance Activities

                                    138.00




                    70.00




     24.13
                            12.81
             7.67                            4.38      5.00
                                                              0.18

     walkthrough      review        inspection-doc   inspection-code
  Time spent by page &
  nº of defects by page
  Quality Assurance Activities

14.00

12.00

10.00

 8.00

 6.00

 4.00

 2.00

 0.00
        PI   SDP SDP QAP CCP CSD UIP   UR SRS SA   TCP   ITS ATS UIR ATR UM
 Nº of effort hours by page &
 nº of defects by page
 Walkthrough Activities

7.00

6.00

5.00

4.00

3.00

2.00

1.00

0.00
       PI   SDP   CSD     UIP   UIR   ATR   UM
Nº of effort hours by page &
nº of defects by page
Review Activities

8.00

7.00

6.00

5.00

4.00
3.00

2.00

1.00

0.00
       SDP   QAP   CCP   UR   SA   TCP   ITS   ATS
 Combined Results
 Walkthrough Activities

40

35

30
                                             Author Effort
25                                           Aut. Eff by Pag
20                                           Avg Effort by Rev
15                                           Avg Def by Rev
                                             Avg Def by Pag
10

5

0
     PI   SDP   CSD   UIP   UIR   ATR   UM
 Combined Results
 Review Activities

70

60

50                                                 Author Effort

40                                                 Aut. Eff by Pag
                                                   Avg Effort by Rev
30                                                 Avg Def by Rev
20                                                 Avg Def by Pag

10

0
     SDP   QAP   CCP   UR   SA   TCP   ITS   ATS
Global Statistics
Code Inspection
                                                         #
         13%
                                            Java         5874

                                   Java     JSP          2444
                                   JSP
                                   VB.net
   26%                                      VB.net       1263
                             61%

                                            Total        9581

                                            % insp       3.49%

                        3%
                                            Minor Def    5

                                            Major Def    7

                                            Potential Hiden Defects

                  97%
                                            Minor        142
                                            Major        200
Change Control Activities
                     Quality Analysis Report




    http://code.google.com/p/isec-deis-mis-ds-ps-group1/
    2008/2009 IPC ISEC-DEIS
      General Statistics
      Change Control Activities

       Data Start   Data End     Days   Impact   Reason
                                        Hours

QAP 04/06/2009      29/06/2009   25     5        Environment Changes

UR     27/05/2009   31/05/2009   4      7        Remove Defects

UR     12/06/2009   13/06/2009   1      1        Environment Changes

SA     10/06/2009   12/06/2009   2      23       Remove Defects

SA     04/07/2009   06/07/2009   2      6        Environment Changes

TCP 01/07/2009      02/07/2009   1      0.5      Environment Changes

ITS    30/06/2009   02/07/2009   2      0.5      Environment Changes
     General Statistics
     Change Control Activities

30
        25
25

20

15

10
                                                     5
              4
5
                         2       2          2
                   1                  1
0
       QAP   UR    UR    SA      SA   TCP   ITS   Average
 Impact of CR &
 development time
 Change Control Activities
35

30

25

20

15

10

5

0
     QAP   UR    UR     SA   SA   TCP   ITS
    Templates, Guidelines, Repository
    Configuration Management


•    Templates
•    Guidelines
•    Checklists
•    Convention for filesname
•    Google Docs + Codes + Groups
•    Other Tools
      –   MS Project is a complex tool ( Openproject
          should be an option next years )
      –   MS Office fulfill its expectations, but
 Network Knowledge
                 Quality Analysis Report




http://code.google.com/p/isec-deis-mis-ds-ps-group1/
2008/2009 IPC ISEC-DEIS
Areas
Network Knowledge



    Area       Description
    PM & RA    Project Management and Risk Analysis
    A& R & I   Architecture, Requirements and
               Implementation
    QA & CC    Quality Assurance and Change Control
    TC         Test Campaign
Forum
Network Knowledge
                        Nº Posts               975

                        Nº Topics              136
     Jul   Apr
    209    110          Avg                    ~7.2


                 May
                 332
   Jun
   324



                                    TC
                                    14               PM & RA
                                                       40
                       A &R&I
                          34




                                         QA & CC
                                           48
Wiki Pages
Network Knowledge




                    TC   PM & RA
                     1      1
         A & R& I
            2




                              QA & CC
                                 7
                                   Survey
                 Quality Analysis Report




http://code.google.com/p/isec-deis-mis-ds-ps-group1/
2008/2009 IPC ISEC-DEIS
Configuration Management &
Quality Management
Survey

   Quality Assurance Questioner                                   Score [0-10]

   The QAP was clear and detailed enough.                         8.4

   The QAP contributed to the successful execution of my tasks.   8.5
   The QAP contributed to the successful execution of the         8.3
   project.

   The Google Mailing List (Forum) contributed to share my        8.9
   knowledge with my colleagues.

   The Google Code (SVN & Wiki) was demonstrated being a          9.3
   properly tool to this project.

   The Google Docs (Weakly Report) was demonstrated being         9.2
   an adequate tool to be used in this project.

   The Quality Manager knew his responsibilities.                 9.3
         Lessons Learned
                 Quality Analysis Report




http://code.google.com/p/isec-deis-mis-ds-ps-group1/
2008/2009 IPC ISEC-DEIS
    Summary
    Lessons Learned

•    Start meetings at time
•    Communication is important
•    Simulate inspections (trainning sessions)
•    Motivation, comprehensive and calm
•    Right choice of development tools
•    Time invested in the project planning
•    Testers should follow the SA/DD development
•    A software project should have a ratio of 3
     developers to 1 tester
Final Conclusion, Recomendations
Quality Analysis Report
•   The Quality Assurance Activities are
    conducted with rigor and accuracy. The
    team members followed the guidelines
    provided by the three plan documents:
    QAP, CCP and TCP.
•   The number of change request (five (5) out
    seven (7) - only two correcting defects)
    shows that mainly the documents are
    developed right the first time.
•   The final product conform its requirements
    and requirements are fully accomplished.
•   The Quality Team presents a several
Thank you !

								
To top