qm_presentation by 196T3f1

VIEWS: 7 PAGES: 32

									SACWIS Implementation: the
Role of Quality Management




Description and Guidelines
               Quality Management
                           Agenda

•    Processes
•    Standards
•    In-House or Vendor?
•    Helpful Links
•    State Questions
•    ACF Guidelines (updates: slides 4 of 4)

November 11,               SACWIS and Quality Management            2
2011                 Children’s Bureau, Division of State Systems
               Quality Management
                     Processes

          Quality Planning
          Quality Assurance (QA)
          Quality Control (QC)
            o Independent Verification &
              Validation (IV&V)


November 11,              SACWIS and Quality Management            3
2011                Children’s Bureau, Division of State Systems
               Quality Management
                    Processes




November 11,             SACWIS and Quality Management            4
2011               Children’s Bureau, Division of State Systems
               Quality Management
                    Processes




November 11,             SACWIS and Quality Management            5
2011               Children’s Bureau, Division of State Systems
               Quality Management
                    Processes

•    Quality Planning Definition:
     The process of identifying which standards
     apply to the project and how to meet the
     standards, with a focus on establishing
     sponsor/ customer requirements, designing
     products and services to meet those
     requirements, establishing quality goals,
     defining processes, and establishing controls
     to use in monitoring the processes.
November 11,             SACWIS and Quality Management            6
2011               Children’s Bureau, Division of State Systems
               Quality Management
                    Processes

•    Quality Assurance (QA) Definition:
     A set of activities designed to ensure that
     the development and/or maintenance
     process is adequate to ensure a system will
     meet its objectives. Quality assurance is
     performed throughout the life-cycle of a
     project.

November 11,             SACWIS and Quality Management            7
2011               Children’s Bureau, Division of State Systems
               Quality Management
                    Processes

•    Quality Control (QC) Definition
     A set of activities designed to evaluate a
     developed work product. QC activities
     focus on finding defects in specific
     deliverables - e.g., are the defined
     requirements the right requirements.



November 11,             SACWIS and Quality Management            8
2011               Children’s Bureau, Division of State Systems
               Quality Management
                    Processes

•    Independent Verification &
     Validation (IV&V) Definition:
     The process in which the products of
     the software development process are
     independently reviewed by a group
     that is neither the developer nor the
     acquirer.
November 11,             SACWIS and Quality Management            9
2011               Children’s Bureau, Division of State Systems
               Quality Management
                    Standards

•    QA/QC should be based on a
     standard
•    QA/QC staff (internal or vendor)
     should specify the standard that
     they use


November 11,             SACWIS and Quality Management            10
2011               Children’s Bureau, Division of State Systems
                   Quality Management
                      Standards (cont’d)

Sources
          Industry standards including
               o   International Organization for Standardization (ISO)
               o   Institute of Electrical and Electronics Engineers, Inc.
                   (IEEE)
               o   Capability Maturity Model Integration (CMM/CMMI)
               o   Project Management Institute (PMI)
          State defined standards and procedures for
           quality management

November 11,                         SACWIS and Quality Management            11
2011                           Children’s Bureau, Division of State Systems
               Quality Management
                Standards (cont’d)
                       ISO

ISO 9000:2000 series
          ISO 9000:2000
          ISO 9001:2000
          ISO 9004:2000


November 11,             SACWIS and Quality Management            12
2011               Children’s Bureau, Division of State Systems
               Quality Management
                Standards (cont’d)
                       ISO




November 11,             SACWIS and Quality Management            13
2011               Children’s Bureau, Division of State Systems
               Quality Management
                Standards (cont’d)
                      IEEE


          IEEE Std 1012:1998
          IEEE Std 730:2002
          IEEE Std 1061:1998
          IEEE Std 982.1:1988

November 11,             SACWIS and Quality Management            14
2011               Children’s Bureau, Division of State Systems
               Quality Management
                Standards (cont’d)
                   CMM/CMMI




November 11,             SACWIS and Quality Management            15
2011               Children’s Bureau, Division of State Systems
               Quality Management
                Standards (cont’d)
                      PMI

•    ISO 9001
•    PMBOK
          ANSI/PMI 99-001-2004
•    PMP Certification


November 11,             SACWIS and Quality Management            16
2011               Children’s Bureau, Division of State Systems
               Quality Management
                 Standards (cont’d)
                ISO – Pros and Cons
•    PROS
          Standard process for evaluating vendors (vendors are
           sanctioned by ISO)
          Certification must be kept up to date
•    CONS
          Not recognized by some American vendors
          Requires significant training to internal project staff to
           interpret the model if implemented in-house
          Assumes that the internal staff is a software/system
           expert
          Most documentation is difficult to understand and interpret
November 11,                    SACWIS and Quality Management            17
2011                      Children’s Bureau, Division of State Systems
               Quality Management
                Standards (cont’d)
               IEEE – Pros and Cons
•    PROS
          Widely recognized
          Standards easily available
          Includes all processes
•    CONS
          Uses a specific vocabulary
          Standards are for purchase
          Assumes a standard lifecycle
          Does not include human resources (staffing)

November 11,                 SACWIS and Quality Management            18
2011                   Children’s Bureau, Division of State Systems
               Quality Management
         Standards (cont’d)
      CMM/CMMI – Pros and Cons
•    PROS
          Model is downloadable
          Standard process for evaluating vendors (assessors are
           sanctioned by SEI)
          Training available on the model
          Includes all processes
•    CONS
          Not recognized by some commercial vendors
          Requires significant training to interpret the model
          Assumes that the internal staff is a software/system
           expert
          Does not include human resources (staffing)


November 11,                    SACWIS and Quality Management            19
2011                      Children’s Bureau, Division of State Systems
               Quality Management
                 Standards (cont’d)
                PMI – Pros and Cons
•    PROS
          A good process for certifying Project Managers
          Widely recognized
          Local chapters of PMI
          Includes Human Resource (staffing)
          Certifies PMs
          Special interest groups, IT, construction, engineering, etc.
          Requires ongoing training to maintain certification
•    CONS
          PMBOK (Project Management Body of Knowledge) not set
           up to evaluate contractors
          Includes only management and support processes

November 11,                    SACWIS and Quality Management            20
2011                      Children’s Bureau, Division of State Systems
               Quality Management
               In-House or Vendor?
                   Internal QA
•    Have your own people trained in doing QA
          Set up internal “Project Management Office”
          Train participants in the appropriate standard
          Have members of the office monitor
           products/processes on project including all
           vendor products/processes
          Monitor each deliverable for compliance to
           standard


November 11,                 SACWIS and Quality Management            21
2011                   Children’s Bureau, Division of State Systems
               Quality Management
    In-House or Vendor? (cont’d)
           External QA
•    Using external staff
          Select appropriate standard
          May want to require certification from vendors in
           standard
          Make certain that you understand the
           certification process!




November 11,                 SACWIS and Quality Management            22
2011                   Children’s Bureau, Division of State Systems
               Quality Management
    In-House or Vendor? (cont’d)
     Internal QA – Pros and Cons
•    PROS
       Less costly
       Develop internal expertise
       Internal staff now trained in project
        management
•    CONS
       Independence may be compromised
       Can be disagreement on the interpretation of the
        standard
       The model and the vendor may use different
        terminology and life cycles

November 11,              SACWIS and Quality Management            23
2011                Children’s Bureau, Division of State Systems
               Quality Management
    In-House or Vendor? (cont’d)
           External QA
•    PROS
          Usually more skilled in project processes
          Usually more knowledgeable of industry
           standards
          Much more independence
•    CONS
          More costly
          Limited by contract terms

November 11,                 SACWIS and Quality Management            24
2011                   Children’s Bureau, Division of State Systems
                   Quality Management
                            Useful Links
•    State Systems Profiles
          www.acf.hhs.gov/nhsitrcapps
•    Sample PMO sites
          Oregon:
               o   egov.oregon.gov/DHS/admin/pmo/publications/pmo_te
                   mplates.shtm
          Tennessee:
               o   www.state.tn.us/finance/oir/qa/safety-qm-plan1.pdf
          Texas:
               o   http://www.dir.state.tx.us/eod/qa/template.htm

November 11,                        SACWIS and Quality Management            25
2011                          Children’s Bureau, Division of State Systems
               Quality Management
               Useful Links (cont’d)
•    “What is ISO 9001:2000” (in easy-speak)
          www.bsiamericas.com
          Click on link at right hand side for free guidance
           documents
•    CMMI and software metrics (in easy-speak)
          http://www.dcs.qmw.ac.uk/~norman/papers/qa
           _metrics_article/section_7_standards.html



November 11,                  SACWIS and Quality Management            26
2011                    Children’s Bureau, Division of State Systems
               Quality Management
               Useful Links (cont’d)
•    ISO
          www.iso.org
•    IEEE
          www.ieee.org
•    CMMI
          www.sei.cmu.edu/cmmi
•    PMI
          www.pmi.org
November 11,                   SACWIS and Quality Management            27
2011                     Children’s Bureau, Division of State Systems
               Quality Management
                State Questions
Discussion:
•    How did you decide to go with a vendor vs.
     in-house for QA?
•    What is your vendor selection process?
•    Do you have examples of management
     reports that you have found useful?
•    What were the lessons learned?

November 11,             SACWIS and Quality Management            28
2011               Children’s Bureau, Division of State Systems
               Quality Management
                  ACF Guidelines

Before you begin:
•       Provide business case to ACF justifying
        (standard) methodology selected; describe
        contributing project uniqueness factors




November 11,             SACWIS and Quality Management            29
2011               Children’s Bureau, Division of State Systems
               Quality Management
                    ACF Guidelines

Best Practices:
•       Management must ensure adherence to roles/
        responsibilities defined in RFP
•       Identify and track outputs/artifacts expected to
        monitor and ensure quality
•       Ensure plan is followed through: rely on defined
        roles/responsibilities, mitigation strategies,
        recommendations
•       Inform ACF of any changes throughout the
        process

November 11,                SACWIS and Quality Management            30
2011                  Children’s Bureau, Division of State Systems
                Quality Management
               ACF Guidelines Summary

In Summary:
•    Is QM a SACWIS requirement? NO
•    Is QM a best practice? YES
•    Submit to ACF:
          Business case
          QM Plan
•    Update ACF of any changes
•    Request technical assistance
November 11,                 SACWIS and Quality Management            31
2011                   Children’s Bureau, Division of State Systems
               THE
               END
November 11,         SACWIS and Quality Management            32
2011           Children’s Bureau, Division of State Systems

								
To top