SQA Training Course by variablepitch340

VIEWS: 43 PAGES: 153

									02/02/97

QA03-95

Welcome to the System Modification Scenario Detailed Software Quality Assurance (SQA) Training Class

System Modification Scenario - Release dtd 7/28/95

Slide 1

02/02/97

QA03-95

Course Overview:

• High level review of SPI, CMM and SMS • Introduce Software Quality Assurance (SQA) • Identify SQA Tasks, Subtasks, and Procedures, as outlined in the SMS

System Modification Scenario - Release dtd 7/28/95

Slide 2

02/02/97

QA03-95

SECTION 1

SPI Review

System Modification Scenario - Release dtd 7/28/95

Slide 3

02/02/97

QA03-95

SPI, CMM, SMS Review
Objectives:
• Define SPI • Define CMM • Identify CMM levels and Level 2 KPAs • Define SMS • Identify levels of the SMS

System Modification Scenario - Release dtd 7/28/95

Slide 4

02/02/97

QA03-95

SPI REVIEW

Software Process Improvement (SPI)

SPI is:
• Effort to Improve Software Process • System of:
– Tasks
– Methods – Tools – Practices

– Standards

• Applicable Throughout Software Life Cycle
System Modification Scenario - Release dtd 7/28/95 Slide 5

02/02/97

QA03-95

CMM REVIEW

Capability Maturity Model (CMM)

A FRAMEWORK FOR EFFECTIVE SOFTWARE PROCESSES
• Identifies: – Maturity Levels – Key Process Areas – Common Features

System Modification Scenario - Release dtd 7/28/95

Slide 6

02/02/97

QA03-95

KEY PROCESS AREAS (KPAs) As Defined by SOFTWARE ENGINEERING INSTITUTE (SEI)
“SOFTWARE ENGINEERING AND MANAGEMENT PRACTICES”

LEVEL 1 - INITIAL

LEVEL 2 -REPEATABLE
REQUIREMENTS MANAGEMENT
PROJECT PLANNING PROJECT TRACKING & OVERSIGHT SUBCONTRACT MANAGEMENT SOFTWARE QUALITY ASSURANCE SOFTWARE CONFIGURATION MANAGEMENT

LEVEL 3 - DEFINED
ORGANIZATION PROCESS FOCUS ORGANIZATION PROCESS DEFINITION TRAINING PROGRAM INTEGRATED SOFTWARE MANAGEMENT SOFTWARE PRODUCT ENGINEERING INTERGROUP COORDINATION PEER REVIEWS

LEVEL 4 - MANAGED
PROCESS MEASUREMENT & ANALYSIS QUALITY MANAGEMENT

LEVEL 5 - OPTIMIZING
DEFECT PREVENTION TECHNOLOGY INNOVATION PROCESS CHANGE MANAGEMENT

System Modification Scenario - Release dtd 7/28/95

Slide 7

02/02/97

QA03-95

SMS REVIEW

System Modification Scenario (SMS)

The SMS is:
– One part of the Software Process Architecture

– Focuses on routine system modification
– Provides: – process definition, – description, and – documentation
System Modification Scenario - Release dtd 7/28/95 Slide 8

02/02/97

SOFTWARE PROCESS ARCHITECTURE

QA03-95

SYSTEM MODIFICATION SCENARIO
CHANGE INITIATION
CHANGE/ PROBLEM DEFINITION PROBLEM (PTR) DOCUMENTATION & DISPOSITION CHANGE (SCR) INITIATION, REVIEW, APROVAL, & RANKING

-

PHASES & SUBPHASES
CHANGE ANALYSIS

CHANGE DEFINITION
FUNCTIONAL REQ’MENTS DEFINITION ANALYSIS PREPARATION

REQUIREMENTS SPECIFICATION & IMPACT ANALYSIS

DESIGN PREPARATION

SYSTEM/ SUBSYSTEM DESIGN

RESOURCE ESTIMATION

CHANGE APPROVAL & PLANNING
PROPOSED RELEASE PACKAGE DEVELOPMENT RELEASE PLANNING ITSA PREP & ACCEPTANCE RELEASE PLANNING CCB REVIEW & APPROVAL DEVELOPMENT ITSA PREP. & ACCEPTANCE

CHANGE DEVELOPMENT
Release Planning
SYSTEM DOCUMENT MODIFICATION DETAILED SAT DEFINITIO N DETAILED SQT DEFINITION

System/Subsystem Design
& CSU SPECIFICATIONS DEVELOPMENT

CHANGE DEVELOPMENT (CONT’D)
DETAILED SIT DEFINITION DETAILED UT DEFINITION UNIT CODING & UNIT TESTING (UT) SIT EXECUTION & CERTIFICATION SQT EXECUTION & CERTIFICATION SAT EXECUTION & CERTIFICATION SOFTWARE BASELINE AUDITS

CHANGE IMPLEMENTATION
RELEASE IMPLEMENTATION POST RELEASE IMPLEMENTATION REVIEW POST RELEASE PHYSICAL CONFIG. AUDIT

PERIODIC PROCESSES
System Modification Scenario - Release dtd 7/28/95
SQA Slide PROCESS 9 REVIEWS

02/02/97

QA03-95

Performance Check

Open the Performance Check booklet to SPI, CMM, SMS Review page and answer the questions.

System Modification Scenario - Release dtd 7/28/95

Slide 10

02/02/97

QA03-95

SECTION 2

Software Quality Assurance Introduction

System Modification Scenario - Release dtd 7/28/95

Slide 11

02/02/97

QA03-95

Software Quality Assurance (SQA) Introduction OBJECTIVES:
• • • • • • Define Software Quality Assurance Identify SQA benefits to management Identify controls in FSO’s SQA Policy Identify SQA goals Identify SQA roles and responsibilities Locate information to support SQA activities

System Modification Scenario - Release dtd 7/28/95

Slide 12

02/02/97

QA03-95

Software Quality Assurance (SQA) Introduction WHAT IS SOFTWARE QUALITY?
“Software

Quality is the degree to which a software product conforms to a set of specified requirements.” *******************

“The degree of excellence required and maintained at an acceptable price.”
SQA TACTICAL WORKING GROUP BRIEF, 9-26-94

System Modification Scenario - Release dtd 7/28/95

Slide 13

02/02/97

QA03-95

Software Quality Assurance (SQA) Introduction
WHAT IS SOFTWARE QUALITY ASSURANCE?
• Framework for
– Independent assessment & insight into » S/W development processes & products

• Ensures conformance to
– Functional & performance requirements – Development standards – S/W Quality Factors

System Modification Scenario - Release dtd 7/28/95

Slide 14

02/02/97

QA03-95

SEI CMM
Level
5 - Optimizing 4 - Managed 3 - Defined

Focus
Continuous Improvement Product & Process Quality Engineering Process

Key Process Areas
Process Change Management Technology Change Management Defect Prevention SW Quality Management Quantitative Process Management Peer Reviews, Intergroup Coordination, Software Product Engineering, Integrated SW Management, Training Program, Organization Process Definition, Organization Process Focus Configuration Management Quality Assurance Subcontract Management Project Tracking & Oversight Project Planning Requirements Management

Result
Quality

2 - Repeatable

Project Management

1 - Initial

Ad Hoc

Risk
System Modification Scenario - Release dtd 7/28/95 Slide 15

02/02/97

QA03-95

Software Quality Assurance (SQA) Introduction CMM’s SQA COMMON FEATURES:
     

Goals Commitment to Perform Ability to Perform Activities Measurement and Analysis Verifying Implementation

System Modification Scenario - Release dtd 7/28/95

Slide 16

02/02/97

QA03-95

Software Quality Assurance (SQA) Introduction GOALS:


Plan Software Quality Assurance Activities Adhere to standards, procedures, and requirements Inform affected personnel of SQA activities and results Address unsolved non-compliance issues
Slide 17







System Modification Scenario - Release dtd 7/28/95

02/02/97

QA03-95

Software Quality Assurance (SQA) Introduction

Commitment to Perform

Project follows a written organizational policy for implementing SQA
System Modification Scenario - Release dtd 7/28/95 Slide 18

02/02/97

QA03-95

Software Quality Assurance (SQA) Introduction
ABILITY TO PERFORM:
•Responsibilities to coordinate and implement SQA Adequate funding and resources are provided
Train

to perform SQA activities

Receive

orientation on role, responsibilities, authority, and value of SQA group

System Modification Scenario - Release dtd 7/28/95

Slide 19

02/02/97

QA03-95

Software Quality Assurance (SQA) Introduction Measurement and Analysis

Determine the cost and schedule status of SQA activities.
System Modification Scenario - Release dtd 7/28/95 Slide 20

02/02/97

QA03-95

Software Quality Assurance (SQA) Introduction Verifying Implementation

• SQA reviews activities with Senior Management • SQA reviews activities with Project Manager • Experts review SQA activities and work products
System Modification Scenario - Release dtd 7/28/95 Slide 21

02/02/97

QA03-95

Software Quality Assurance (SQA) Introduction
SQA ROLES & RESPONSIBILITIES
Customer FSO HQ FSA Director Technical Project Officer FSO Corp. SQA Staff SQA Project SQA Software Developers
System Modification Scenario - Release dtd 7/28/95

Correct/Complete Requirement Def. Proper Funding & Interim Assess. Support Create SQA Environment Verify Standard System Scenarios Process Compliance Product Compliance Responsible for QA
SQA TACTICAL WORKING GROUP BRIEF, 9-26-94
Slide 22

02/02/97

QA03-95

Software Quality Assurance (SQA) Introduction
SQA ROLES & RESPONSIBILITIES
Functional Project Officer Technical Project Officer Technical Project Officer Technical Project Officer Release Manager SIT Manager Technical Project Officer
System Modification Scenario - Release dtd 7/28/95

FRR SRR CDR RER Release Plans TRR PIR
Slide 23

02/02/97

QA03-95

Software Quality Assurance (SQA) Introduction

POLICY
PURPOSE: • Establish DFAS FSO SQA Program • Delegate FSO authority through FSAs and DSEs • Ensure software products – Are high quality – Meet customer expectations – Satisfy requirements
System Modification Scenario - Release dtd 7/28/95 Slide 24

02/02/97

QA03-95

Software Quality Assurance (SQA) Introduction

POLICY
SCOPE:


Applicable to all Defense Finance and Accounting Financial Systems Activities Applicable to contractors supporting DFAS AIS development





To be implemented throughout the life cycle of all newly developed, migratory and legacy Automated Information Systems (AISs)
Slide 25

System Modification Scenario - Release dtd 7/28/95

02/02/97

QA03-95

Software Quality Assurance (SQA) Introduction

POLICY
GOALS /OBJECTIVES:
 

Plan and measure SQA activities

Employ software development methods techniques
to minimize maintenance cost



Inform management and other affected groups of SQA activities and results
System Modification Scenario - Release dtd 7/28/95 Slide 26

02/02/97

QA03-95

Software Quality Assurance (SQA) Introduction

POLICY
GOALS /OBJECTIVES CON’T:


Adherence of software products and activities to applicable standards, procedures and requirements is verified objectively Unresolved noncompliance issues are addressed by Senior Management To provide feedback and assessment channels
System Modification Scenario - Release dtd 7/28/95 Slide 27





02/02/97

QA03-95

Software Quality Assurance (SQA) Introduction
QUALITY FACTORS
The following steps serve as a starting point for tracking and measuring quality: • • • • • Select system characteristics Determine set of quality factors Extract criteria for each factor Incorporate into review checklists Translate results into guidelines

System Modification Scenario - Release dtd 7/28/95

Slide 28

02/02/97

QA03-95

Software Quality Assurance (SQA) Introduction System Characteristics and Related Quality Factors
System Characteristics
Human lives are affected

Important Quality Factors
Reliability Correctness Testability Maintainability Flexibility Portability Reusability Efficiency Reliability Correctness

Long life cycle

Real Time Application

System Modification Scenario - Release dtd 7/28/95

Slide 29

02/02/97

QA03-95

Software Quality Assurance (SQA) Introduction System Characteristics and Related Quality Factors
System Characteristics
Classified Information Processed Interfacing with Related Systems On-board Computer Applications

Important Quality Factors
Integrity Interoperability Efficiency Reliability Correctness

DoD-Wide Applications

Portability Reliability Interoperability Integrity Flexibility Reusability
Slide 30

System Modification Scenario - Release dtd 7/28/95

02/02/97

QA03-95

Software Quality Assurance (SQA) Introduction System Characteristics and Related Quality Factors
System Characteristics
Client Server Application

Important Quality Factors
Efficiency Reliability Portability Interoperability Integrity Efficiency Portability Interoperability Reusability Integrity Maintainability Flexibility Reusability
Slide 31

PC Based Applications

I-Case Repository Applications

System Modification Scenario - Release dtd 7/28/95

02/02/97

QA03-95

Software Quality Assurance (SQA) Introduction
Example of Relationship of Criteria to Software Quality Factors
CORRECTNESS

TRACEABILITY

CONSISTENCY

COMPLETENESS

RELIABILITY

CONSISTENCY ERROR TOLERANCE

ACCURACY SIMPLICITY

System Modification Scenario - Release dtd 7/28/95

Slide 32

02/02/97

QA03-95

Software Quality Assurance (SQA) Introduction
Example of Incorporating Criteria into Review Checklist
Review Checklist
Quality Factor: MAINTAINABILITY Questions Yes No (1) Does this unit have high internal cohesion and low external coupling (e.g., changes to this unit do not have unforeseen effects within the unit and have minimal effects on other units)? (2) Has the complexity of this design been minimized? (3) Does the header meet project standards? (e.g., purpose, author, environment, files, development history, explanatory notes) (4) Does the unit exhibit clarity, readability, and modifiability?
System Modification Scenario - Release dtd 7/28/95 Slide 33

02/02/97

QA03-95

Software Quality Assurance (SQA) Introduction
Analyze/translate checklist results
(1) Count each “yes” answer and each question as one. (2) Summarize the “yes” answers for each quality factor (3) Divide the total of column 1 by the total of column 2 (4) Quotient = % or quality achieved. Log that value in the Quality Review Summary Report.

Computational Example: Quality Factor Criteria
Maintainability Modularity Self-Descriptiveness Consistency Simplicity Conciseness

# Yes 0 2 2 2 4

Total # Questions 2 2 6 3 7

Quotient

10
System Modification Scenario - Release dtd 7/28/95

20

=

50%
Slide 34

02/02/97

QA03-95

Software Quality Assurance (SQA) Introduction
Quality Profile Graph: Milestone = CDR
% of Quality Achieved
70 60 50

40
30 20 10 0
Maintainability Portability
Flexibility

Usability

Reusability

Integrity

System Modification Scenario - Release dtd 7/28/95

Slide 35

02/02/97

QA03-95

Software Quality Assurance (SQA) Introduction

DEVELOPING THE SQA PLAN
• The SQA Plan delineates all of the SQA activities that are required and are to be conducted over the life of the project. The size of the SQA plan varies depending on the size and scope of the effort it is to support. The Software Project Manager defines the requirements for and approves the project/system SQA plan.
Slide 36

• •

System Modification Scenario - Release dtd 7/28/95

02/02/97

QA03-95

Software Quality Assurance (SQA) Introduction

DEVELOPING THE SQA PLAN (Con’t)
• Other organizations will contribute to and support the scheduled activities of the SQA plan.

•

The SQA plan is published as an attachment to the Software Development Plan.

System Modification Scenario - Release dtd 7/28/95

Slide 37

02/02/97

QA03-95

Software Quality Assurance (SQA) Introduction SQA PLAN TEMPLATE
1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. 13. Purpose & Scope References Documented Project Profile Description Management Strategies Documentation Requirements Standards Identification Reviews and Audits Identification Software Configuration Management Plan Description Testing Description Defect Tracking and Problem Reporting Tools and Techniques Training Requirements Identification Risk Management Employed

System Modification Scenario - Release dtd 7/28/95

Slide 38

02/02/97

QA03-95

Performance Check

Open the Performance Check booklet to Software Quality Assurance Introduction page and answer the questions.

System Modification Scenario - Release dtd 7/28/95

Slide 39

02/02/97

QA03-95

SECTION 3

SMS & SQA Relationship

System Modification Scenario - Release dtd 7/28/95

Slide 40

02/02/97

QA03-95

SMS & SQA RELATIONSHIP
OBJECTIVE:
–

Use the SMS to perform • SQA tasks • subtasks • procedures.

System Modification Scenario - Release dtd 7/28/95

Slide 41

02/02/97

SOFTWARE PROCESS ARCHITECTURE

QA03-95

SYSTEM MODIFICATION SCENARIO
CHANGE INITIATION
CHANGE/ PROBLEM DEFINITION PROBLEM (PTR) DOCUMENTATION & DISPOSITION CHANGE (SCR) INITIATION, REVIEW, APROVAL, & RANKING

-

PHASES & SUBPHASES
CHANGE ANALYSIS

CHANGE DEFINITION
FUNCTIONAL REQ’MENTS DEFINITION ANALYSIS PREPARATION

REQUIREMENTS SPECIFICATION & IMPACT ANALYSIS

DESIGN PREPARATION

SYSTEM/ SUBSYSTEM DESIGN

RESOURCE ESTIMATION

CHANGE APPROVAL & PLANNING
PROPOSED RELEASE PACKAGE DEVELOPMENT RELEASE PLANNING ITSA PREP & ACCEPTANCE RELEASE PLANNING CCB REVIEW & APPROVAL DEVELOPMENT ITSA PREP. & ACCEPTANCE

CHANGE DEVELOPMENT
Release Planning
SYSTEM DOCUMENT MODIFICATION DETAILED SAT DEFINITIO N DETAILED SQT DEFINITION

System/Subsystem Design
& CSU SPECIFICATIONS DEVELOPMENT

CHANGE DEVELOPMENT (CONT’D)
DETAILED SIT DEFINITION DETAILED UT DEFINITION UNIT CODING & UNIT TESTING (UT) SIT EXECUTION & CERTIFICATION SQT EXECUTION & CERTIFICATION SAT EXECUTION & CERTIFICATION SOFTWARE BASELINE AUDITS

CHANGE IMPLEMENTATION
RELEASE IMPLEMENTATION POST RELEASE IMPLEMENTATION REVIEW POST RELEASE PHYSICAL CONFIG. AUDIT

PERIODIC PROCESSES
System Modification Scenario - Release dtd 7/28/95
SQA Slide PROCESS 42 REVIEWS

02/02/97

QA03-95

CHANGE ANALYSIS PHASE

1 TASK

Requirements Specifications & Impact Analysis Subphase

System Requirements Review

System Modification Scenario - Release dtd 7/28/95

Slide 43

02/02/97

QA03-95

Standard (s): Input (s):
Analysts Review Report
FSA Impacted SCR Installation/Implementation Plan (IIP) Ranked SCR List SQA Plan SRR Open Action Item List Previous SRR Summary Report
FSO KPA WG Guidelines DoD 2168

Output (s):
Completed SRR Checklist SRR Open Action Item List SRR Package

System Requirements Review (SRR) Task (1 of 1) Purpose: Ensure that detailed functional requirements reflect customer’s definition

SRR Summary Report

Skill(s):
Functional Expertise Software Engineering SQA Testing User Expertise
Slide 44

System Modification Scenario - Release dtd 7/28/95

02/02/97

QA03-95

4 Subtasks
System Requirements Review (SRR) Task SRR Planning/Preparation SRR Execution SRR Reporting SRR Follow-Up

System Modification Scenario - Release dtd 7/28/95

Slide 45

02/02/97

QA03-95

System Requirements Review (SRR) Task
SRR Preparation/Planning Subtask 1 of 4
•

Identify SCRs for Review, SRR participants, meeting recorder, and each SCR presenter Schedule SRR Facilities Develop SRR Agenda

• •

•
• •

Notify Participants of SRR
Tailor and/or expand SRR Checklist Prepare SRR Package

•

Distribute SRR Package
Slide 46

System Modification Scenario - Release dtd 7/28/95

02/02/97

QA03-95

System Requirements Review (SRR) Task
SRR Execution Subtask 2 of 4
• • • • •

Facilitate SRR Validate Functional Specifications Ensure Quality Compliance of Functional Specifications Document SRR Evaluate SRR
System Modification Scenario - Release dtd 7/28/95 Slide 47

02/02/97

QA03-95

System Requirements Review (SRR) Task
SRR Reporting Subtask 3 of 4

• •

Prepare SRR Summary Report Distribute SRR Summary Report

System Modification Scenario - Release dtd 7/28/95

Slide 48

02/02/97

QA03-95

System Requirements Review (SRR) Task
SRR Follow-Up Subtask 4 of 4

• •

Collect and Annotate SRR Metrics Generate Metric Report

•
•

Collect SRR Action Items
Track and Report SRR Action Items

System Modification Scenario - Release dtd 7/28/95

Slide 49

02/02/97

QA03-95

Performance Check

Using the Performance Check directions, the SMS and the SRR Package. Student will participate in a simulated SRR.

System Modification Scenario - Release dtd 7/28/95

Slide 50

02/02/97

SOFTWARE PROCESS ARCHITECTURE

QA03-95

SYSTEM MODIFICATION SCENARIO
CHANGE INITIATION
CHANGE/ PROBLEM DEFINITION PROBLEM (PTR) DOCUMENTATION & DISPOSITION CHANGE (SCR) INITIATION, REVIEW, APROVAL, & RANKING

-

PHASES & SUBPHASES
CHANGE ANALYSIS

CHANGE DEFINITION
FUNCTIONAL REQ’MENTS DEFINITION ANALYSIS PREPARATION

REQUIREMENTS SPECIFICATION & IMPACT ANALYSIS

DESIGN PREPARATION

SYSTEM/ SUBSYSTEM DESIGN

RESOURCE ESTIMATION

CHANGE APPROVAL & PLANNING
PROPOSED RELEASE PACKAGE DEVELOPMENT RELEASE PLANNING ITSA PREP & ACCEPTANCE RELEASE PLANNING CCB REVIEW & APPROVAL DEVELOPMENT ITSA PREP. & ACCEPTANCE

CHANGE DEVELOPMENT
Release Planning
SYSTEM DOCUMENT MODIFICATION DETAILED SAT DEFINITIO N DETAILED SQT DEFINITION

System/Subsystem Design
& CSU SPECIFICATIONS DEVELOPMENT

CHANGE DEVELOPMENT (CONT’D)
DETAILED SIT DEFINITION DETAILED UT DEFINITION UNIT CODING & UNIT TESTING (UT) SIT EXECUTION & CERTIFICATION SQT EXECUTION & CERTIFICATION SAT EXECUTION & CERTIFICATION SOFTWARE BASELINE AUDITS

CHANGE IMPLEMENTATION
RELEASE IMPLEMENTATION POST RELEASE IMPLEMENTATION REVIEW POST RELEASE PHYSICAL CONFIG. AUDIT

PERIODIC PROCESSES
System Modification Scenario - Release dtd 7/28/95
SQA Slide PROCESS 51 REVIEWS

02/02/97

SYSTEM MODIFICATION SCENARIO
RESOURCE ESTIMATION SUBPHASE TASKS
SCR SIZE ESTIMATE PREPARATION

QA03-95

SCR EFFORT ESTIMATE PREPARATION

SCR CRITICAL COMPUTER-RESOURCE ESTIMATES PREPARATION

Note: These estimates refer to SCRs or CIs

SCR FIRM FIXED PRICE PREPARATION

RESOURCE ESTIMATION REVIEW
System Modification Scenario - Release dtd 7/28/95
ANALYSIS PREPARATION

CHANGE ANALYSIS PHASE SUBPHASES
REQUIREMENT SPECIFICATION & IMPACT ANALYSIS DESIGN PREPARATION

Slide SYSTEM/ SUBSYSTEM DESIGN

52

RESOURCE ESTIMATION

02/02/97

QA03-95

CHANGE ANALYSIS PHASE

1 TASK

Resource Estimation Subphase

Resource Estimation Review

System Modification Scenario - Release dtd 7/28/95

Slide 53

02/02/97

QA03-95

Standard (s): Input (s):
CDR Open Action Item List SDP Documentation SRR Open Action Item List
Selected SMS Resource Estimation Method

Output (s):

Resource Estimation Review Task (1 of 1) Purpose: Provide management with assurance that estimates have been developed and agreed upon

Findings Report

Skill(s):
Development Software Quality Assurance

System Modification Scenario - Release dtd 7/28/95

Slide 54

02/02/97

QA03-95

4 Subtasks

Resource Estimation Review Task

RER Planning/Preparation RER Execution RER Reporting

RER Follow-Up

System Modification Scenario - Release dtd 7/28/95

Slide 55

02/02/97

QA03-95

Resource Estimation Review Task
RER Planning/Preparation Subtask 1 of 4

•
• • •

Schedule RER Facilities Develop RER Agenda Notify Participants of RER Develop RER Package

•

Distribute RER Package
Slide 56

System Modification Scenario - Release dtd 7/28/95

02/02/97

QA03-95

Resource Estimation Review Task
RER Execution Subtask 2 of 4
• •

Facilitate RER Validate SCR and Resource Estimates

•
• •

Ensure Quality Compliance of Resource Estimation
Document Resource Estimation Review Evaluate Resource Estimation Review
Slide 57

System Modification Scenario - Release dtd 7/28/95

02/02/97

QA03-95

Resource Estimation Review Task
RER Reporting Subtask 3 of 4

• •

Prepare RER Summary Report Distribute RER Summary Report

System Modification Scenario - Release dtd 7/28/95

Slide 58

02/02/97

QA03-95

Resource Estimation Review Task
RER Follow-Up Subtask 4 of 4

• •

Track and Report Action Items Correct Discrepancies

System Modification Scenario - Release dtd 7/28/95

Slide 59

02/02/97

QA03-95

Performance Check

Open the Performance Check booklet to the Resource Estimation Review Task and answer the questions.

System Modification Scenario - Release dtd 7/28/95

Slide 60

02/02/97

SOFTWARE PROCESS ARCHITECTURE

SYSTEM MODIFICATION SCENARIO
CHANGE INITIATION
CHANGE/ PROBLEM DEFINITION PROBLEM (PTR) DOCUMENTATION & DISPOSITION CHANGE (SCR) INITIATION, REVIEW, APROVAL, & RANKING

-

QA03-95

PHASES & SUBPHASES
CHANGE ANALYSIS

CHANGE DEFINITION
FUNCTIONAL REQ’MENTS DEFINITION ANALYSIS PREPARATION

REQUIREMENTS SPECIFICATION & IMPACT ANALYSIS

DESIGN PREPARATION

SYSTEM/ SUBSYSTEM DESIGN

RESOURCE ESTIMATION

CHANGE APPROVAL & PLANNING
PROPOSED RELEASE PACKAGE DEVELOPMENT RELEASE PLANNING ITSA PREP & ACCEPTANCE RELEASE PLANNING CCB REVIEW & APPROVAL DEVELOPMENT ITSA PREP. & ACCEPTANCE

CHANGE DEVELOPMENT
Release Planning
SYSTEM DOCUMENT MODIFICATION DETAILED SAT DEFINITIO N DETAILED SQT DEFINITION

System/Subsystem Design
& CSU SPECIFICATIONS DEVELOPMENT

CHANGE DEVELOPMENT (CONT’D)
DETAILED SIT DEFINITION DETAILED UT DEFINITION UNIT CODING & UNIT TESTING (UT) SIT EXECUTION & CERTIFICATION SQT EXECUTION & CERTIFICATION SAT EXECUTION & CERTIFICATION SOFTWARE BASELINE AUDITS

CHANGE IMPLEMENTATION
RELEASE IMPLEMENTATION POST RELEASE IMPLEMENTATION REVIEW POST RELEASE PHYSICAL CONFIG. AUDIT

PERIODIC PROCESSES
System Modification Scenario - Release dtd 7/28/95
SQA Slide PROCESS 61 REVIEWS

02/02/97

SYSTEM MODIFICATION SCENARIO
Release Planning SUBPHASE TASKS
RELEASE PACKAGE ANALYSIS PROJECT TEMP MODIFICATION

QA03-95

RESOURCE AVAILABILITY DETERMINATION

PROJECT SAT TEST PLAN DEVELOPMENT

SOFTWARE DEVELOPMENT PLAN (SDP) PREPARATION

PROJECT SCM PLAN MODIFICATION

PROJECT SQT TEST PLAN DEVELOPMENT

SQA RELEASE PLANS CERTIFICATION

PROJECT SQA PLAN MODIFICATION

PROJECT SIT TEST PLAN DEVELOPMENT

CHANGE DEVELOPMENT PHASE SUBPHASES
Release Planning
SYSTEM DOCUMENT MODIFICATION DETAILED SAT DEFINITION DETAILED SQT DEFINITION

Sys/Subsystem Design
& CSU SPEC DEVELOPMENT

DETAILED SIT DEFINITION

System Modification Scenario - Release dtd 7/28/95
DETAILED UT DEFINITION UNIT CODING & TESTING SIT EXECUTION & CERTIFICATION SQT EXECUTION & CERTIFICATION

Slide 62
SAT EXECUTION & CERTIFICATION SOFTWARE BASELINE AUDITS

02/02/97

QA03-95

CHANGE APPROVAL & PLANNING PHASE

2 TASKS

Release

Project SQA Plan Modification

Planning

SQA Release Plans Certification

Subphase

System Modification Scenario - Release dtd 7/28/95

Slide 63

02/02/97

QA03-95

Standards:
DFAS FSO KPA WG SQA Guidelines DoD 2168 DoD Directive 5000.1

Inputs:
Proposed Release Package

Output:
Project SQA Plan Modification Task (1 of 2) Purpose: Modify SQA plan

Modified SQA Plan

SQA Plan

Skills:
Functional Expertise Project Management Software Engineering Software Quality Assurance

System Modification Scenario - Release dtd 7/28/95

Slide 64

02/02/97

QA03-95

14 Subtasks
SQAP Purpose & Scope Definition SQAP References Documented SQAP Project Profile Description SQAP Management Strategies SQAP Documentation Requirements SQAP Standards Identification SQAP Reviews & Audits Identification SQAP Plan SCM Plan Description SQAP Testing Description SQAP Defect Tracking & Problem Reporting SQAP Tools and Techniques SQAP SQA Training Requirements Identification SQAP Risk Management Employed SQAP SQA Plan Certification
Slide 65

Project

Software
Quality Assurance Plan Modification Task
System Modification Scenario - Release dtd 7/28/95

02/02/97

QA03-95

Project SQA Plan Modification Task

SQAP Purpose & Scope Definition Subtask 1 of 14

Modify, as necessary:
• • SQA Purpose Definition SQA Scope Definition

System Modification Scenario - Release dtd 7/28/95

Slide 66

02/02/97

QA03-95

Project SQA Plan Modification Task

SQAP References Documented Subtask 2 of 14 Modify, as necessary: • Appropriate documents as referenced in SQA plan - document numbers - titles - revision number - data
System Modification Scenario - Release dtd 7/28/95 Slide 67

02/02/97

QA03-95

Project SQA Plan Modification Task
SQAP Project Profile Description Subtask 3 of 14 • • • • Document Changes to Complexity Matrix Identify Minimum Requirements Identify Changes to Quality Goals Selected Software Engineering Methodology

System Modification Scenario - Release dtd 7/28/95

Slide 68

02/02/97

QA03-95

Project SQA Plan Modification Task
SQAP Management Strategies Subtask 4 of 14 • • • SQA Task/Responsibility Matrix Changes SQA Metrics Collection & Repository Changes SQA Report Requirement Changes

System Modification Scenario - Release dtd 7/28/95

Slide 69

02/02/97

QA03-95

Project SQA Plan Modification Task
SQAP Documentation Requirements Subtask 5 of 14

•
•

Identifies all documentation to support software development, verification and validation
Outlines Responsibility Matrix

System Modification Scenario - Release dtd 7/28/95

Slide 70

02/02/97

QA03-95

Project SQA Plan Modification Task
SQAP Standards Identification Subtask 6 of 14
• • Requirements Analysis Format & Content Documentation Standards

•
• •

Logic Structure Standards
Coding Standards Commentary Standards

•
•

Testing Standards
Program Complexity Metrics Standards
Slide 71

System Modification Scenario - Release dtd 7/28/95

02/02/97

QA03-95

Project SQA Plan Modification Task
SQAP Review & Audits Identification Subtask 7 of 14 • • Describe the Reviews and Audits Note how the following are accomplished: • • • • Inspections Audits Walkthroughs Reviews
Slide 72

System Modification Scenario - Release dtd 7/28/95

02/02/97

QA03-95

Project SQA Plan Modification Task

SQAP SCM Plan Description Subtask 8 of 14

•

Identifies how compliance with the CM Plan is monitored

System Modification Scenario - Release dtd 7/28/95

Slide 73

02/02/97

QA03-95

Project SQA Plan Modification Task

SQAP Testing Description Subtask 9 of 14 •

Ensure Test Plan Modification

•

Modify how compliance is monitored

System Modification Scenario - Release dtd 7/28/95

Slide 74

02/02/97

QA03-95

Project SQA Plan Modification Task

SQAP Defect Tracking & Problem Reporting Subtask 10 of 14

Modify and/or Ensure • Defect Tracking

•

Problem Reporting

System Modification Scenario - Release dtd 7/28/95

Slide 75

02/02/97

QA03-95

Project SQA Plan Modification Task
SQAP Tools & Techniques Subtask 11 of 14

Modify:
• Tools used to perform SQA activities • Checklists Techniques used to perform SQA activities • function point analysis • interviews • simulation modeling • quantitative analysis
Slide 76

•

System Modification Scenario - Release dtd 7/28/95

02/02/97

QA03-95

Project SQA Plan Modification Task
SQAP Training Requirements Identification Subtask 12 of 14

Identify Training Requirements for: • • SQA Personnel Project Personnel

System Modification Scenario - Release dtd 7/28/95

Slide 77

02/02/97

QA03-95

Project SQA Plan Modification Task
SQAP Risk Management Employed Subtask 13 of 14 • • Identify, Assess, Monitor, & Control Areas of Risk Determine Likelihood of Risk

•

Determine Severity of Adverse Effects Resulting from Risk

System Modification Scenario - Release dtd 7/28/95

Slide 78

02/02/97

QA03-95

Project SQA Plan Modification Task

SQA Plan Certification Subtask 14 of 14 • • • Routing Evaluation Certification

System Modification Scenario - Release dtd 7/28/95

Slide 79

02/02/97

QA03-95

Performance Check

Open the Performance Checklist booklet to Project Software Quality Assurance Plan Modification and perform the exercise.

System Modification Scenario - Release dtd 7/28/95

Slide 80

02/02/97

QA03-95

Standard (s):
DFAS FSO KPA WG SQA Guidelines DoD Directive 5000.1 DoD 2168

Input (s):
Release SCMP Release SQAP Release Test Plans Release SDP

Output (s):
SQA Release Plans Certification Task (2 of 2) Purpose: Review and and approve each modified project plan
Cert. Release SCMP Cert. Release SQAP Cert. Release Test Plans Cert. Release SDP

Skill(s):
Software Quality Assurance

System Modification Scenario - Release dtd 7/28/95

Slide 81

02/02/97

QA03-95

4 Subtasks
Software
Quality Assurance Release Plans Certification Release SQAP Evaluation & Certification Release Test Plans Evaluation & Certification Release SDP Evaluation & Certification
Slide 82

Release SCMP Evaluation & Certification

Task

System Modification Scenario - Release dtd 7/28/95

02/02/97

QA03-95

SQA Release Plans Certification Task
Release SCMP Evaluation & Certification Subtask 1 of 4 •

Verify the current SCM Plan has been approved

•

Discuss discrepancies with appropriate project management personnel

System Modification Scenario - Release dtd 7/28/95

Slide 83

02/02/97

QA03-95

SQA Release Plans Certification Task
Release SQAP Evaluation & Certification Subtask 2 of 4

•

Verify SQA Plan has been approved

•

Discuss discrepancies with appropriate project management personnel

System Modification Scenario - Release dtd 7/28/95

Slide 84

02/02/97

QA03-95

SQA Release Plans Certification Task
Release Test Plans Evaluation & Certification Subtask 3 of 4 • Verify Release Test SCM Plans have been developed and approved Discuss discrepancies with appropriate project management personnel

•

System Modification Scenario - Release dtd 7/28/95

Slide 85

02/02/97

QA03-95

SQA Release Plans Certification Task
Release SDP Evaluation & Certification Subtask 4 of 4

•
•

Verify SDP Plan has been accurately prepared
Discuss discrepancies with appropriate project management personnel

System Modification Scenario - Release dtd 7/28/95

Slide 86

02/02/97

QA03-95

Performance Check

Open the Performance Check booklet to the SQA Release Plans Certification Task and answer the questions.

System Modification Scenario - Release dtd 7/28/95

Slide 87

02/02/97

SOFTWARE PROCESS ARCHITECTURE

SYSTEM MODIFICATION SCENARIO
CHANGE INITIATION
CHANGE/ PROBLEM DEFINITION PROBLEM (PTR) DOCUMENTATION & DISPOSITION CHANGE (SCR) INITIATION, REVIEW, APROVAL, & RANKING

-

QA03-95

PHASES & SUBPHASES
CHANGE ANALYSIS

CHANGE DEFINITION
FUNCTIONAL REQ’MENTS DEFINITION ANALYSIS PREPARATION

REQUIREMENTS SPECIFICATION & IMPACT ANALYSIS

DESIGN PREPARATION

SYSTEM/ SUBSYSTEM DESIGN

RESOURCE ESTIMATION

CHANGE APPROVAL & PLANNING
PROPOSED RELEASE PACKAGE DEVELOPMENT RELEASE PLANNING ITSA PREP & ACCEPTANCE RELEASE PLANNING CCB REVIEW & APPROVAL DEVELOPMENT ITSA PREP. & ACCEPTANCE

CHANGE DEVELOPMENT
Release Planning
SYSTEM DOCUMENT MODIFICATION DETAILED SAT DEFINITIO N DETAILED SQT DEFINITION

System/Subsystem Design
& CSU SPECIFICATIONS DEVELOPMENT

CHANGE DEVELOPMENT (CONT’D)
DETAILED SIT DEFINITION DETAILED UT DEFINITION UNIT CODING & UNIT TESTING (UT) SIT EXECUTION & CERTIFICATION SQT EXECUTION & CERTIFICATION SAT EXECUTION & CERTIFICATION SOFTWARE BASELINE AUDITS

CHANGE IMPLEMENTATION
RELEASE IMPLEMENTATION POST RELEASE IMPLEMENTATION REVIEW POST RELEASE PHYSICAL CONFIG. AUDIT

PERIODIC PROCESSES
System Modification Scenario - Release dtd 7/28/95
SQA Slide PROCESS 88 REVIEWS

02/02/97

SYSTEM MODIFICATION SCENARIO

QA03-95

System/Subsystem Design & COMPUTER SOFTWARE UNIT (CSU) SPECIFICATIONS DEVELOPMENT SUBPHASE

TASKS

DETAILED DESIGN & CSU SPECIFICATIONS TRACKING & OVRSGHT

Critical Design Review

IMPACT ANALYSIS REVIEW

DETAILED COMPUTER SOFTWARE UNIT SPECIFICATIONS DEVELOPMENT

Detailed System Design

RELEASE IMPLEMENTATION PLAN DEVELOPMENT

CHANGE DEVELOPMENT PHASE SUBPHASES
Release Planning
SYSTEM DOCUMENT MODIFICATION DETAILED SAT DEFINITION DETAILED SQT DEFINITION

Sys/Subsystem Design
& CSU SPEC DEVELOPMENT

DETAILED SIT DEFINITION

System Modification Scenario - Release dtd 7/28/95
DETAILED UT DEFINITION UNIT CODING & TESTING SIT EXECUTION & CERTIFICATION SQT EXECUTION & CERTIFICATION

Slide 89
SAT EXECUTION & CERTIFICATION SOFTWARE BASELINE AUDITS

02/02/97

QA03-95

1 TASK
CHANGE DEVELOPMENT PHASE

System/Subsystem Design & CSU

Critical Design Review
Specifications
Development Subphase

System Modification Scenario - Release dtd 7/28/95

Slide 90

02/02/97

QA03-95

Critical Design Review (CDR)Task
Review

PURPOSE:
• Verify that the modified detailed system design is complete & correct

• Verify that the design satisfies both functional and technical system requirements • Verify that the design adheres to DoD, DFAS & FSO standards
Slide 91

System Modification Scenario - Release dtd 7/28/95

02/02/97

QA03-95

Standard (s): Input (s):
Design Documents FSA Impacted SCR SQA Plan
FSO KPA WG Guidelines DoD 2168

Output (s):
CDR Package CDR Summary Report Completed CDR Checklist

Critical Design Review Task (1 of 1) Purpose: Verify detailed system design is correct, satisfy requirements, and adhere to standards

Skill(s):
Development Functional Expertise Software Quality Assurance Testing

System Modification Scenario - Release dtd 7/28/95

Slide 92

02/02/97

QA03-95

4 Subtasks

Critical CDR Planning/Preparation Design CDR Execution CDR Reporting CDR Follow-Up

Review Task

System Modification Scenario - Release dtd 7/28/95

Slide 93

02/02/97

QA03-95

Critical Design Review (CDR) Task
CDR Planning/Preparation Subtask 1 of 4

• • • • • • •

Determine CDR Participants, Format, Execution Schedule CDR Facilities Develop CDR Agenda Notify Participants of CDR Tailor and/or Expand CDR Checklist Develop CDR Package Distribute CDR Package

System Modification Scenario - Release dtd 7/28/95

Slide 94

02/02/97

QA03-95

Critical Design Review (CDR) Task
CDR Execution Subtask 2 of 4
• • • • •

Facilitate CDR Validate Detailed System Design Assure Quality Compliance of Critical Design Document CDR Evaluate CDR
Slide 95

System Modification Scenario - Release dtd 7/28/95

02/02/97

QA03-95

Critical Design Review (CDR) Task
CDR Reporting Subtask 3 of 4
•

Prepare CDR Summary Report

•

Distribute CDR Summary Report

System Modification Scenario - Release dtd 7/28/95

Slide 96

02/02/97

QA03-95

Critical Design Review (CDR) Task
CDR Follow-Up Subtask 4 of 4
• • • •

Collect and Annotate CDR Metrics

Generate Quality Metric Reports
Collect and Annotate CDR Action Items Track and Report CDR Action Items

System Modification Scenario - Release dtd 7/28/95

Slide 97

02/02/97

QA03-95

Performance Check

Open the Performance Check booklet to the Critical Design Review (CDR) Task and answer the questions regarding the CDR.

System Modification Scenario - Release dtd 7/28/95

Slide 98

02/02/97

SOFTWARE PROCESS ARCHITECTURE

SYSTEM MODIFICATION SCENARIO
CHANGE INITIATION
CHANGE/ PROBLEM DEFINITION PROBLEM (PTR) DOCUMENTATION & DISPOSITION CHANGE (SCR) INITIATION, REVIEW, APROVAL, & RANKING

-

QA03-95

PHASES & SUBPHASES
CHANGE ANALYSIS

CHANGE DEFINITION
FUNCTIONAL REQ’MENTS DEFINITION ANALYSIS PREPARATION

REQUIREMENTS SPECIFICATION & IMPACT ANALYSIS

DESIGN PREPARATION

SYSTEM/ SUBSYSTEM DESIGN

RESOURCE ESTIMATION

CHANGE APPROVAL & PLANNING
PROPOSED RELEASE PACKAGE DEVELOPMENT RELEASE PLANNING ITSA PREP & ACCEPTANCE RELEASE PLANNING CCB REVIEW & APPROVAL DEVELOPMENT ITSA PREP. & ACCEPTANCE

CHANGE DEVELOPMENT
Release Planning
SYSTEM DOCUMENT MODIFICATION DETAILED SAT DEFINITIO N DETAILED SQT DEFINITION

System/Subsystem Design
& CSU SPECIFICATIONS DEVELOPMENT

CHANGE DEVELOPMENT (CONT’D)
DETAILED SIT DEFINITION DETAILED UT DEFINITION UNIT CODING & UNIT TESTING (UT) SIT EXECUTION & CERTIFICATION SQT EXECUTION & CERTIFICATION SAT EXECUTION & CERTIFICATION SOFTWARE BASELINE AUDITS

CHANGE IMPLEMENTATION
RELEASE IMPLEMENTATION POST RELEASE IMPLEMENTATION REVIEW POST RELEASE PHYSICAL CONFIG. AUDIT

PERIODIC PROCESSES
System Modification Scenario - Release dtd 7/28/95
SQA Slide PROCESS 99 REVIEWS

02/02/97

QA03-95

2 TASKS
CHANGE DEVELOPMENT PHASE

Software Integration Test Execution &

SIT Readiness Review

SIT Certification

Certification
Subphase

System Modification Scenario - Release dtd 7/28/95

Slide 100

02/02/97

QA03-95

Standard (s): Input (s):
Changes to SCR Reqmt/ Design specs Subsequent to the SRR Current User/System Documentation Developer’s informal Test Results Outstanding Deficiency Reports from CDR Release Dev Schedule /Status Reqmts Traceability Matrix SIT Plan SQA Responsibility Matrix SQA TRR Checklist Test Conditions/ Transactions DFAS FSO KPA WG SQA Guidelines DFAS 8000.1-R Chap. 11

Output (s):
SIT Readiness Review Task (1 of 2) Purpose: SIT Readiness Review is conducted, changes completed and tested, SIT environment is established
Completed SIT Readiness Review Checklist SIT Readiness Review Package SIT Readiness Review Summary Report SIT Readiness Review Agenda Test Preparation Checklist

Skill(s):
Development Functional Expertise SQA Technical Testing

System Modification Scenario - Release dtd 7/28/95

Slide 101

02/02/97

QA03-95

4 Subtasks

SIT Readiness Review Task

SIT Readiness Rev. Planning/Prep. SIT Readiness Rev. Executing SIT Readiness Rev. Reporting

SIT Readiness Rev. Follow-Up

System Modification Scenario - Release dtd 7/28/95

Slide 102

02/02/97

QA03-95

Software Integration Test Readiness Review Task
SIT Readiness Review Planning/Preparation Subtask 1 of 4
•

Identify SCRs for Review, SIT Readiness Review participants, meeting recorder, and each SCR presenter Schedule SIT Readiness Review Facilities Develop SIT Readiness Review Agenda Notify Participants of SIT Readiness Review Tailor and/or expand SIT Readiness Review Checklist Prepare SIT Readiness Review Package Distribute SIT Readiness Review Package
System Modification Scenario - Release dtd 7/28/95 Slide 103

• • • • • •

02/02/97

QA03-95

Software Integration Test Readiness Review Task
SIT Readiness Review Execution Subtask 2 of 4 • • • • • Facilitate SIT Readiness Review Validate Functional Specifications Assure Quality Compliance of Functional Specifications Document SIT Readiness Review Evaluate SIT Readiness Review
Slide 104

System Modification Scenario - Release dtd 7/28/95

02/02/97

QA03-95

Software Integration Test Readiness Review Task
SIT Readiness Review Reporting Subtask 3 of 4

• •

Prepare SIT Readiness Review Summary Report Distribute SIT Readiness Review Summary Report

System Modification Scenario - Release dtd 7/28/95

Slide 105

02/02/97

QA03-95

Software Integration Test Readiness Review Task
SIT Readiness Review Follow-Up Subtask 4 of 4

• Collect and Annotate SIT Readiness Review Metrics
• • • Generate SIT Readiness Review Metrics Report Collect SIT Readiness Review Action Items Track and Report SIT Readiness Review Action Items

System Modification Scenario - Release dtd 7/28/95

Slide 106

02/02/97

QA03-95

Performance Check

Open the Performance Check booklet to the Software Integration Test Readiness Review and answer the questions.

System Modification Scenario - Release dtd 7/28/95

Slide 107

02/02/97

QA03-95

Input (s):
SIT Certification Task (2 of 2) Purpose: Ensure all requirements have been met- SIT successfully completed, validated

Output (s):

Test Analysis Report

Test Discrepancy Report

CMIS Certification Entry

Test Results

Skills:
Project Management

System Modification Scenario - Release dtd 7/28/95

Slide 108

02/02/97

QA03-95

1 Subtask
Software Integration Test Certification SIT Software Qualification Assurance Certification

System Modification Scenario - Release dtd 7/28/95

Slide 109

02/02/97

QA03-95

Software Integration Test Certification Task
SIT Software Qualification Assurance Certification Subtask 1 of 1

• •

Results of SIT execution are reviewed Ensure Test deficiencies/discrepancies are documented

•

Ensure resolution and documentation of corrective actions
Slide 110

System Modification Scenario - Release dtd 7/28/95

02/02/97

SOFTWARE PROCESS ARCHITECTURE

QA03-95

SYSTEM MODIFICATION SCENARIO
CHANGE INITIATION
CHANGE/ PROBLEM DEFINITION PROBLEM (PTR) DOCUMENTATION & DISPOSITION CHANGE (SCR) INITIATION, REVIEW, APROVAL, & RANKING

-

PHASES & SUBPHASES
CHANGE ANALYSIS

CHANGE DEFINITION
FUNCTIONAL REQ’MENTS DEFINITION ANALYSIS PREPARATION

REQUIREMENTS SPECIFICATION & IMPACT ANALYSIS

DESIGN PREPARATION

SYSTEM/ SUBSYSTEM DESIGN

RESOURCE ESTIMATION

CHANGE APPROVAL & PLANNING
PROPOSED RELEASE PACKAGE DEVELOPMENT RELEASE PLANNING ITSA PREP & ACCEPTANCE RELEASE PLANNING CCB REVIEW & APPROVAL DEVELOPMENT ITSA PREP. & ACCEPTANCE

CHANGE DEVELOPMENT
Release Planning
SYSTEM DOCUMENT MODIFICATION DETAILED SAT DEFINITIO N DETAILED SQT DEFINITION

System/Subsystem Design
& CSU SPECIFICATIONS DEVELOPMENT

CHANGE DEVELOPMENT (CONT’D)
DETAILED SIT DEFINITION DETAILED UT DEFINITION UNIT CODING & UNIT TESTING (UT) SIT EXECUTION & CERTIFICATION SQT EXECUTION & CERTIFICATION SAT EXECUTION & CERTIFICATION SOFTWARE BASELINE AUDITS

CHANGE IMPLEMENTATION
RELEASE IMPLEMENTATION POST RELEASE IMPLEMENTATION REVIEW POST RELEASE PHYSICAL CONFIG. AUDIT

PERIODIC PROCESSES
System Modification Scenario - Release dtd 7/28/95
SQA Slide PROCESS 111 REVIEWS

02/02/97

QA03-95

CHANGE IMPLEMENTATION PHASE

1 TASK

Post Release Implementation Review Subphase

Post Implementation Review

System Modification Scenario - Release dtd 7/28/95

Slide 112

02/02/97

QA03-95

Standard (s):
DFAS FSO KPA WG SQA Guidelines

Input (s):
Planned vs Actual Release Data
PTR SQA KPA Guidelines PIR Checklist SQA KPA Guidelines PIR Questionnaires

Output (s):
Completed PIR Questionnaires Completed PIR Checklist PIR Agenda PIR Summary Report

Post Implementation Review Task (1 of 1) Purpose: To validate implementation procedures, software changes, user training, documentation

Skill(s):
Development Functional Expertise SQA Technical Testing

PIR Package

System Modification Scenario - Release dtd 7/28/95

Slide 113

02/02/97

QA03-95

4 Subtasks

Post Implementation Review

PIR Planning/Preparation PIR Execution

Task

PIR Reporting

PIR Follow-Up

System Modification Scenario - Release dtd 7/28/95

Slide 114

02/02/97

QA03-95

Post Implementation Review Task
PIR Planning/Preparation Subtask 1 of 4 • • • • • • • Schedule Post Implementation Review Facilities Identify SCRs for Review, PIR participants, meeting recorder and each presenter Develop Post Implementation Review Agenda Prepare and distribute questionnaires Analyze metrics data Prepare & include Preliminary Findings Report Develop PIR Package
System Modification Scenario - Release dtd 7/28/95 Slide 115

02/02/97

QA03-95

Post Implementation Review Task
PIR Execution Subtask 2 of 4 • • • • • Facilitate the Post Implementation Review Validate Functional Specifications Assure Quality Compliance of Functional Specifications Document Post Implementation Review Evaluate Post Implementation Review

System Modification Scenario - Release dtd 7/28/95

Slide 116

02/02/97

QA03-95

Post Implementation Review Task
PIR Reporting Subtask 3 of 4

• •

Prepare Post Implementation Review Summary Report Distribute Post Implementation Review Summary Report

System Modification Scenario - Release dtd 7/28/95

Slide 117

02/02/97

QA03-95

Post Implementation Review Task
PIR Follow-Up Subtask 4 of 4

•
•

Collect and Annotate Post Implementation Review Metrics
Generate Post Implementation Review Metrics Report

•
•

Collect Post Implementation Review Action Items
Track and Report Post Implementation Review Action Items
System Modification Scenario - Release dtd 7/28/95 Slide 118

02/02/97

QA03-95

Performance Check

Open the Performance Check booklet to the Post Implementation Review Task and answer the questions.

System Modification Scenario - Release dtd 7/28/95

Slide 119

02/02/97

SOFTWARE PROCESS ARCHITECTURE

SYSTEM MODIFICATION SCENARIO
CHANGE INITIATION
CHANGE/ PROBLEM DEFINITION PROBLEM (PTR) DOCUMENTATION & DISPOSITION CHANGE (SCR) INITIATION, REVIEW, APROVAL, & RANKING

-

QA03-95

PHASES & SUBPHASES
CHANGE ANALYSIS

CHANGE DEFINITION
FUNCTIONAL REQ’MENTS DEFINITION ANALYSIS PREPARATION

REQUIREMENTS SPECIFICATION & IMPACT ANALYSIS

DESIGN PREPARATION

SYSTEM/ SUBSYSTEM DESIGN

RESOURCE ESTIMATION

CHANGE APPROVAL & PLANNING
PROPOSED RELEASE PACKAGE DEVELOPMENT RELEASE PLANNING ITSA PREP & ACCEPTANCE RELEASE PLANNING CCB REVIEW & APPROVAL DEVELOPMENT ITSA PREP. & ACCEPTANCE

CHANGE DEVELOPMENT
Release Planning
SYSTEM DOCUMENT MODIFICATION DETAILED SAT DEFINITIO N DETAILED SQT DEFINITION

System/Subsystem Design
& CSU SPECIFICATIONS DEVELOPMENT

CHANGE DEVELOPMENT (CONT’D)
DETAILED SIT DEFINITION DETAILED UT DEFINITION UNIT CODING & UNIT TESTING (UT) SIT EXECUTION & CERTIFICATION SQT EXECUTION & CERTIFICATION SAT EXECUTION & CERTIFICATION SOFTWARE BASELINE AUDITS

CHANGE IMPLEMENTATION
RELEASE IMPLEMENTATION POST RELEASE IMPLEMENTATION REVIEW POST RELEASE PHYSICAL CONFIG. AUDIT

PERIODIC PROCESSES
System Modification Scenario - Release dtd 7/28/95
SQA Slide PROCESS 120 REVIEWS

02/02/97

QA03-95

CHANGE IMPLEMENTATION PHASE

2 TASKS

Post Release Physical Configuration Audit Subphase

Reporting

Metrics Tabulation

System Modification Scenario - Release dtd 7/28/95

Slide 121

02/02/97

QA03-95

Standard (s):
DFAS FSO KPA WG SQA Guidelines

Input (s):
Software Baseline Audit Findings Report

Output (s):

Post-Release Physical Configuration Audit Reporting Task (1 of 2) Purpose: Review discrepancies, corrective action and responsible individuals.

Software Baseline Audit Findings Report

Skill(s):
Configuration Management SQA

System Modification Scenario - Release dtd 7/28/95

Slide 122

02/02/97

QA03-95

Post-Release PCA Reporting Task

•
•

SQA & SCM review S/W Baseline Audit Findings Report
Results of audit reported to AIS PM.

System Modification Scenario - Release dtd 7/28/95

Slide 123

02/02/97

QA03-95

Standard (s):
DFAS FSO KPA WG SQA Guidelines

Input (s):
Types of CI reviewed # Cis in each type # errors found Time to correct.

Output (s):

Post-Release Physical Configuration Audit Metrics Tabulation Task (2 of 2) Purpose: Collect metrics

Tabulated Metrics

Skill(s):
Configuration Management SQA

System Modification Scenario - Release dtd 7/28/95

Slide 124

02/02/97

QA03-95

Post-Release PCA Metrics Tabulation Task

•
• •

Types of Configuration Items reviewed
Number of Configuration Items reviewed in each type Number of errors found

•

Time elapsed to correct errors

System Modification Scenario - Release dtd 7/28/95

Slide 125

02/02/97

SOFTWARE PROCESS ARCHITECTURE

QA03-95

SYSTEM MODIFICATION SCENARIO
CHANGE INITIATION
CHANGE/ PROBLEM DEFINITION PROBLEM (PTR) DOCUMENTATION & DISPOSITION CHANGE (SCR) INITIATION, REVIEW, APROVAL, & RANKING

-

PHASES & SUBPHASES
CHANGE ANALYSIS

CHANGE DEFINITION
FUNCTIONAL REQ’MENTS DEFINITION ANALYSIS PREPARATION

REQUIREMENTS SPECIFICATION & IMPACT ANALYSIS

DESIGN PREPARATION

SYSTEM/ SUBSYSTEM DESIGN

RESOURCE ESTIMATION

CHANGE APPROVAL & PLANNING
PROPOSED RELEASE PACKAGE DEVELOPMENT RELEASE PLANNING ITSA PREP & ACCEPTANCE RELEASE PLANNING CCB REVIEW & APPROVAL DEVELOPMENT ITSA PREP. & ACCEPTANCE

CHANGE DEVELOPMENT
Release Planning
SYSTEM DOCUMENT MODIFICATION DETAILED SAT DEFINITIO N DETAILED SQT DEFINITION

System/Subsystem Design
& CSU SPECIFICATIONS DEVELOPMENT

CHANGE DEVELOPMENT (CONT’D)
DETAILED SIT DEFINITION DETAILED UT DEFINITION UNIT CODING & UNIT TESTING (UT) SIT EXECUTION & CERTIFICATION SQT EXECUTION & CERTIFICATION SAT EXECUTION & CERTIFICATION SOFTWARE BASELINE AUDITS

CHANGE IMPLEMENTATION
RELEASE IMPLEMENTATION POST RELEASE IMPLEMENTATION REVIEW POST RELEASE PHYSICAL CONFIG. AUDIT

PERIODIC PROCESSES
System Modification Scenario - Release dtd 7/28/95
SQA Slide PROCESS 126 REVIEWS

02/02/97

QA03-95

4 Tasks

SQA Process Review

Planning/Preparation
SQA Process Reviews Subphase

SQA Process Review Execution

SQA Process Review Reporting

SQA Process Review Follow-Up

System Modification Scenario - Release dtd 7/28/95

Slide 127

02/02/97

QA03-95

SQA Process Reviews
OBJECTIVES: Process compliance...
Provide independent verification Provide visibility to management Provide mechanism for resolution of deficiencies

System Modification Scenario - Release dtd 7/28/95

Slide 128

02/02/97

QA03-95

Standard (s):
DFAS FSO KPA WG SQA Guidelines

Input (s):
SQA Process Review Planning/Preparation Task (1 of 4) Purpose: Set up review

Output (s):

SQAP

Process Compliance Checklist

Skill(s):
SQA

System Modification Scenario - Release dtd 7/28/95

Slide 129

02/02/97

QA03-95

7 Subtasks
Review Format and Content Development Review Facilities Scheduling Review Agenda Development Review Notification

SQA Process
Review Planning/ Preparation Task

Review Documentation Collection
and Checklist Preparation Review Package Preparation Review Package Distribution

System Modification Scenario - Release dtd 7/28/95

Slide 130

02/02/97

QA03-95

SQA Process Review Planning/Preparation Task
Format and Content Development Subtask 1 of 7
• Identify: – Review participants

– Review Coordinator
– Documentation presenter – Determine Format and Execution of Review – Make other necessary arrangements

System Modification Scenario - Release dtd 7/28/95

Slide 131

02/02/97

QA03-95

SQA Process Review Planning/Preparation Task
Review Facilities Scheduling Subtask 2 of 7

•
•

Determine location
Arrange for: – meeting time – seating capacity – equipment

•

Reserve facility for time needed

System Modification Scenario - Release dtd 7/28/95

Slide 132

02/02/97

QA03-95

SQA Process Review Planning/Preparation Task
Review Agenda Development Subtask 3 of 7

Set agenda to include:
• Format • Assignments

• List of participants
• Time – To evaluate documentation – To Identify discrepancies – To find possible solutions.
System Modification Scenario - Release dtd 7/28/95 Slide 133

02/02/97

QA03-95

SQA Process Review Planning/Preparation Task
Review Notification Subtask 4 of 7 • Inform participants of: – Location – Time • Notify participants of: – Material to be reviewed – Timeframe allotted

• Advise persons of any special assignments

System Modification Scenario - Release dtd 7/28/95

Slide 134

02/02/97

QA03-95

SQA Process Review Planning/Preparation Task
Review Documentation Collection & Checklist Preparation Subtask 5 of 7

• Obtain documentation for review

• Tailor checklist for project

System Modification Scenario - Release dtd 7/28/95

Slide 135

02/02/97

QA03-95

SQA Process Review Planning/Preparation Task
Review Package Preparation Subtask 6 of 7

Include: • Agenda with list of participants

• Tailored checklist(s)
• Documentation to be reviewed

System Modification Scenario - Release dtd 7/28/95

Slide 136

02/02/97

QA03-95

SQA Process Review Planning/Preparation Task
Review Package Distribution Subtask 7 of 7

• Distribute at least 3 working days prior to review

System Modification Scenario - Release dtd 7/28/95

Slide 137

02/02/97

QA03-95

Standard (s):
DFAS FSO KPA WG SQA Guidelines

Input (s):
SQA Process Review Execution Task (2 of 4) Purpose: Examine representative sample of project activities

Output (s):

Process Compliance Checklist

Process Compliance Checklist

Skill(s):
SQA

System Modification Scenario - Release dtd 7/28/95

Slide 138

02/02/97

QA03-95

3 Subtasks

SQA
Process Review Execution Task

Process Document Validation Process Interviews Review Results Documentation and Evaluation

System Modification Scenario - Release dtd 7/28/95

Slide 139

02/02/97

QA03-95

SQA Process Review Execution Task
Process Document Validation Subtask 1 of 3 • Participants will examine documentation to answer each item in the compliance checklist. • Non-compliant items will have reasons documented

System Modification Scenario - Release dtd 7/28/95

Slide 140

02/02/97

QA03-95

SQA Process Review Execution Task
Process Interviews Subtask 2 of 3 • Process Interviewer: – Conducts interview by agenda and schedule – States purpose, scope – May be mediator and recorder • Subsequent interviews may be requested

System Modification Scenario - Release dtd 7/28/95

Slide 141

02/02/97

QA03-95

SQA Process Review Execution Task
Review Results Documentation & Evaluation Subtask 3 of 3 • Documentation: – Process deviations – Areas of concern – Compliance checklist • Review Coordinator reiterates status of each item

System Modification Scenario - Release dtd 7/28/95

Slide 142

02/02/97

QA03-95

Standard (s):
DFAS FSO KPA WG SQA Guidelines

Input (s):
SQA Process Review Reporting Task (3 of 4) Purpose: Document review& inform management & project personnel of results.

Output (s):

Process Compliance Checklist

SQA Review Summary Report

Skill(s):
SQA

System Modification Scenario - Release dtd 7/28/95

Slide 143

02/02/97

QA03-95

2 Subtasks

SQA

Review Summary Report Preparation Review Summary Report Distribution

Process
Review Reporting Task

System Modification Scenario - Release dtd 7/28/95

Slide 144

02/02/97

QA03-95

SQA Process Review Reporting Task
Review Summary Report Preparation Subtask 1 of 2 • Review Coordinator uses: – Sample in SQA Guidelines – Compliance checklist results – Information from previous subtask • Review Coordinator creates written report

System Modification Scenario - Release dtd 7/28/95

Slide 145

02/02/97

QA03-95

SQA Process Review Reporting Task
Review Summary Report Distribution Subtask 2 of 2 • Distributed to: – All participants – Appropriate management personnel • Reviewed by all • Any necessary changes agreed to by all

System Modification Scenario - Release dtd 7/28/95

Slide 146

02/02/97

QA03-95

Standard (s):
DFAS FSO KPA WG SQA Guidelines

Input (s):
SQA Process Review Follow-up Task (4 of 4) Purpose: Maintain records, gather input for Summary Report

Output (s):

SQA Review Summary Report

Action Item Log Action Item Notification Metrics Report

Skill(s):
SQA

System Modification Scenario - Release dtd 7/28/95

Slide 147

02/02/97

QA03-95

3 Subtasks

SQA
Process Review Follow-Up Task

Review Metrics Collection and Entry Review Action Item Collection and Entry Review Action Item Tracking and Reporting

System Modification Scenario - Release dtd 7/28/95

Slide 148

02/02/97

QA03-95

SQA Process Review Follow-Up Task
Review Metrics Collection & Entry Subtask 1 of 3 • Prepare SQA Metrics Report • Automated repository or manual log

System Modification Scenario - Release dtd 7/28/95

Slide 149

02/02/97

QA03-95

SQA Process Review Follow-Up Task
Review Action Item Collection & Entry Subtask 2 of 3 Action Item Notification for each Summary Report process deviation

System Modification Scenario - Release dtd 7/28/95

Slide 150

02/02/97

QA03-95

SQA Process Review Follow-Up Task
Review Action Item Tracking & Reporting Subtask 3 of 3

• Action Item Log created & used for:
– Documenting status – Coordinating with project personnel to close item

– SQA validates any supporting documentation
• Log is updated to inform appropriate: – Management – Project personnel
System Modification Scenario - Release dtd 7/28/95 Slide 151

02/02/97

QA03-95

Performance Check

Open the Performance Check booklet to SQA Process Reviews page and answer the questions.

System Modification Scenario - Release dtd 7/28/95

Slide 152

02/02/97

QA03-95

CONGRATULATIONS YOU HAVE SUCCESSFULLY COMPLETED THE SOFTWARE QUALITY ASSURANCE COURSE

System Modification Scenario - Release dtd 7/28/95

Slide 153


								
To top