NASA IV&V Metrics
Independent Verification & Validation Program
IVV 12 Revision: E Effective Date: December 17, 2008
DOWNLOADED AND/OR HARD COPY UNCONTROLLED Verify that this is the correct version before use. APPROVAL SIGNATURES Gregory Blaney (original signature on IMS Representative file) DATE 12/17/2008
Rev. No. Basic A B
C D E
REVISION HISTORY Description of Change Author Initial Release Stephanie Ferguson Changed section referenced for email Stephanie instructions in Section 6.2 Ferguson Updated the following: Section 4.0 Stephanie modify flow to include metrics reporting Ferguson at QMRs, Section 5.0 to include roles, Section 6 to provide more detail regarding analysis or metrics and QMR reporting. Modified the flow in Section 4.0 to now Stephanie include two separate flows. Ferguson Update process flow diagrams to align Stephanie with Facility Management paradigm Ferguson Changed “IV&V Facility” to “IV&V Stephanie Program” Ferguson
Effective Date 03/23/2005 07/08/2005 01/17/2006
10/24/2006 08/06/2007 12/17/2008
Document Number IVV QM IVV 16 NPR 1441.1
REFERENCE DOCUMENTS Document Title IV&V Quality Manual Control of Records NASA Records Retention Schedule
CHECK THE MASTER LIST at http://ims.ivv.nasa.gov VERIFY THAT THIS IS THE CORRECT REVISION BEFORE USE
1 of 5
NASA IV&V Metrics
Independent Verification & Validation Program 1.0 Purpose
IVV 12 Revision: E Effective Date: December 17, 2008
The purpose of this system level procedure (SLP) is to document the process and responsibilities for collecting and reporting metrics and maintaining the NASA IV&V Metrics Table (Metrics Table). Collecting metrics helps the NASA IV&V Program achieve its strategic goals and objectives, as well as continually improve products, processes, and services. NASA IV&V’s continual improvement processes depend upon regularly updating objective performance measurements contained in the Metrics Table. 2.0 Scope This SLP is applicable to all metrics generated by the NASA IV&V Management System (IMS) as well as metrics that are approved to be included in the NASA IV&V Metrics Program and captured within the Metrics Table. 3.0 Definitions and Acronyms Official NASA IV&V roles and terms are defined in the Quality Manual. Specialized definitions identified in this SLP are defined below. 3.1 Metric A metric is a specific metric listed in the Metrics Table. 3.2 Requester The Requester is anyone supporting NASA IV&V who identifies a need for a change to a metric in the Metrics Table. 3.3 Acronyms IMS MCCB MTR NPR QM QMR SLP NASA IV&V Management System Metrics Configuration and Control Board Metrics Table Reviser NASA Procedural Requirements Quality Manual Quarterly Management Review System Level Procedure
CHECK THE MASTER LIST at http://ims.ivv.nasa.gov VERIFY THAT THIS IS THE CORRECT REVISION BEFORE USE
2 of 5
NASA IV&V Metrics
Independent Verification & Validation Program
IVV 12 Revision: E Effective Date: December 17, 2008
4.0
Process Flow Diagrams The following diagrams depict processes described in this document and the responsibilities and actions that shall be performed by process participants. 4.1 Collecting, Analyzing, Reporting, and Maintaining Metrics
METRIC OWNER
Collects Metrics
Analyzes Metrics
Performs Follow-up Actions
Communicates and Reports Metrics at Quarterly Management Review (QMR)
Maintains Metrics (Performs Annual Metrics Review at End of Calendar Year)
CHECK THE MASTER LIST at http://ims.ivv.nasa.gov VERIFY THAT THIS IS THE CORRECT REVISION BEFORE USE
3 of 5
NASA IV&V Metrics
Independent Verification & Validation Program 4.2 Modifying Metrics
METRICS CONFIGURATION CONTROL BOARD (MCCB)
IVV 12 Revision: E Effective Date: December 17, 2008
REQUESTER
IMS REPRESENTATIVE
METRICS TABLE REVISER (MTR)
Submits Request for Addition, Deletion, or Revision of a Metric
Coordinates MCCB Meeting NO
Approves Request
YES
Updates Metrics Table and Change Log
Notifies IMS Mailing List
The Request shall be sent to the IMS Representative with the subject line "Metrics Table Update - Goal ". To request a new metric, the Request must contain all information required by the columns in the Metrics Table. To request a metric revision, the Request must contain the Metrics Table field names and updated values. To request deletion of a metric, the Request must contain a valid reason for deleting the metric.
CHECK THE MASTER LIST at http://ims.ivv.nasa.gov VERIFY THAT THIS IS THE CORRECT REVISION BEFORE USE
4 of 5
NASA IV&V Metrics
Independent Verification & Validation Program 5.0 Metrics
IVV 12 Revision: E Effective Date: December 17, 2008
Any metrics associated with this SLP are established and tracked within the NASA IV&V Metrics Program. 6.0 Records The following records will be generated and filed in accordance with this SLP and IVV 16, Control of Records, and in reference to NASA Procedural Requirements (NPR) 1441.1, NASA Records Retention Schedules.
Record Name Metrics Table Original Y Vital Y Responsible Person MTR Retention Requirement Destroy when 7 yrs old (1/26.5A) Location Shared Network Drive
CHECK THE MASTER LIST at http://ims.ivv.nasa.gov VERIFY THAT THIS IS THE CORRECT REVISION BEFORE USE
5 of 5