Program Execution Plan
Independent Verification & Validation Program
IVV 09-8 Revision: H Effective Date: February 23, 2009
DOWNLOADED AND/OR HARD COPY UNCONTROLLED Verify that this is the correct version before use. APPROVAL SIGNATURES Gregory Blaney (original IMS Representative signature on file) DATE 02/23/2009
Rev. No. Basic A
B
REVISION HISTORY Description of Change Initial Release Change process owner to Christina Moats and remove bullet referring to “allow approx. 55k dollars for contractor costs” Added SAR peer review process, additional definitions, records in section 8, and other minor corrections. Added metrics references in section 8 to address PAR#13775, added Website curator to definitions section 3, and other minor grammatical corrections. Updated for organizational changes. Annual Review and consideration of clarification suggestions. Annual Review and update to reflect change in Project Startup activities Update process flow diagrams to align with Facility Management paradigm Change the focus of SLP from project level to program level; also change title, context, and content
Author John Marinaro Christina Moats
Effective Date 09/12/2002 09/24/2003
C
Steve Pukansky, Stephanie Ferguson Frank Huy, Christina Moats Christina Moats Christina Moats Christina Moats Stephanie Ferguson Christina Moats
05/07/2004
10/04/2004
D E F G H
08/12/2005 02/17/2006 03/16/2007 09/18/2007 02/23/2009
CHECK THE MASTER LIST at http://ims.ivv.nasa.gov/ VERIFY THAT THIS IS THE CORRECT REVISION BEFORE USE
1 of 8
Program Execution Plan
Independent Verification & Validation Program
IVV 09-8 Revision: H Effective Date: February 23, 2009
Document Number IVV QM IVV 09-4 IVV 16 S3005 S3006 S3106 NPR 1441.1
REFERENCE DOCUMENTS Document Title Independent Verification & Validation Quality Manual Project Management Control of Records Program Execution Plan (PEP) Program Execution Plan (PEP) Timeline Portfolio Based Risk Assessment (PBRA) Process NASA Records Retention Schedules
CHECK THE MASTER LIST at http://ims.ivv.nasa.gov/ VERIFY THAT THIS IS THE CORRECT REVISION BEFORE USE
2 of 8
Program Execution Plan
Independent Verification & Validation Program 1.0 Purpose
IVV 09-8 Revision: H Effective Date: February 23, 2009
The purpose of this system level procedure (SLP) is to establish a consistent and documented method of executing the NASA IV&V Program. 2.0 Scope This SLP applies to all NASA IV&V personnel who perform program execution activities for the NASA IV&V Program. 3.0 Definitions and Acronyms Official NASA IV&V roles and terms are defined in the Quality Manual. Specialized definitions identified in this SLP are defined below. 3.1 Execution Plans (EP) Execution plans are generated by each Functional Lead to address goals for the coming or current year. Each EP has a unique identifier: IV&V Project EP (IPEP), Product Line EP (PLEP), Engineer EP (EEP), Knowledge Management EP (KMEP), Operations EP (OEP), or Outreach/Communications EP (OUTEP). 3.2 IV&V Project In the context of this SLP, an IV&V Project is any IV&V task (or collection of tasks) being performed by the NASA IV&V Program for a customer or a NASA development project (depending on context). 3.3 Portfolio Based Risk Assessment (PBRA) The PBRA is the NASA IV&V Program’s risk assessment process, documented in S3016, Portfolio Based Risk Assessment (PBRA) Process. This process is utilized to assess the capabilities within each project to determine which should be considered for IV&V support.
CHECK THE MASTER LIST at http://ims.ivv.nasa.gov/ VERIFY THAT THIS IS THE CORRECT REVISION BEFORE USE
3 of 8
Program Execution Plan
Independent Verification & Validation Program
IVV 09-8 Revision: H Effective Date: February 23, 2009
3.4
Product Lines Product lines are specific, functional, technical teams focused on Modeling, Validation, Verification, or Architecture. Each product line team has a designated Product Line Lead (PLL).
3.5
Acronyms CE EEP EP IBD IMS IPEP KM KMEP MTO NPR OEP Ops Out/Comm OUTEP PL PLEP PLL QM RMO SLP Chief Engineer Engineer Execution Plan Execution Plan IV&V Board of Directors NASA IV&V Management System IV&V Project Execution Plan Chief of Knowledge Management Knowledge Management Execution Plan Management Task Order NASA Procedural Requirement Operations Execution Plan Chief of Operations Chief of Communications Outreach/Communications Execution Plan Project Lead Product Line Execution Plan Product Line Lead Quality Manual Resource Management Office System Level Procedure
CHECK THE MASTER LIST at http://ims.ivv.nasa.gov/ VERIFY THAT THIS IS THE CORRECT REVISION BEFORE USE
4 of 8
Program Execution Plan
Independent Verification & Validation Program 4.0 Process Flow Diagrams
IVV 09-8 Revision: H Effective Date: February 23, 2009
The following diagrams depict processes described in this document, and the responsibilities and actions that shall be performed by process participants. All three flows must be completed sequentially. The process is initiated after a lessons learned discussion (covering the past year’s effort) and timeline updates, if necessary.
Plans and Programs Services Functional Leads (PLL, CE, KM, Ops, Out/Comm) RMO Senior Leadership
Communicate PEP Timeline Identify Resource Requirements (Salaries, Travel, Training)
Identify work requirements
Review / Finalize PBRA Results
Perform PBRA
Generate Cost Estimates
Develop Initial EPs (IPEP, PLEP, EEP, KMEP, OEP, OUTEP) Generate Initial Cost Estimates
Draft IBD Charts (outline and story)
The first process flow identifies the initial actions to be completed in order to generate a set of draft charts documenting the IV&V Program’s funding priorities for a given year. These charts are utilized to convey the IV&V recommendations to the IV&V Board of Directors (IBD). Activities that cross lanes (e.g., “Identify work requirements”) are to be completed by both of the groups identified in the
CHECK THE MASTER LIST at http://ims.ivv.nasa.gov/ VERIFY THAT THIS IS THE CORRECT REVISION BEFORE USE
5 of 8
Program Execution Plan
Independent Verification & Validation Program
IVV 09-8 Revision: H Effective Date: February 23, 2009
lane title (e.g., Services and Functional Leads). The activities in this process flow may be iterative but will conclude with a set of draft IBD charts. While Senior Leadership has no defined activities in this process, it will be provided regular status briefings on the progress. The PBRA Process is documented in S3106, Portfolio Based Risk Assessment (PBRA) Process.
Plans and Programs Services Functional Leads (PLL, CE, KM, Ops, Out/Comm) RMO Senior Leadership
Initial Review and Concurrence of Funding Priorities
Consolidate Cost Estimates
Concurrence for Program Spend Plan Reconciliation
Complete EPs
Finalize IBD Charts
Present Recommendations to IBD
This process flow identifies the actions to be completed in order to finalize the IBD charts documenting the IV&V Program’s funding priorities for a given year. Activities that cross lanes (e.g., “Complete EPs”) are to be completed by both of the groups identified in the lane title (e.g., Services and Functional Leads). The activities in this process flow may be iterative but will conclude with a set of finalized set of IBD charts that have been presented to the IBD. While RMO has
CHECK THE MASTER LIST at http://ims.ivv.nasa.gov/ VERIFY THAT THIS IS THE CORRECT REVISION BEFORE USE
6 of 8
Program Execution Plan
Independent Verification & Validation Program
IVV 09-8 Revision: H Effective Date: February 23, 2009
no defined activities in this process, the Chief of Plans and Programs works closely with the RMO to perform Consolidate Cost Estimates.
Plans and Programs
Report out IBD Decisions (and adjust plans, if necessary) Mechanize MTOs Finalize EPs and NNDs (PLs)
Services
Functional Leads (PLL, CE, KM, Ops, Out/Comm)
RMO
Senior Leadership
Review/ Approve all EPs
Finalize IV&V Program Execution Plan
This process flow identifies the actions to be completed after the meeting with the IBD has occurred. Activities that cross lanes (e.g., “Finalize EPs”) are to be completed by both of the groups identified in the lane title (e.g., Services and Functional Leads). The activities in this process flow may be iterative but will conclude with a final approved program execution plan. The MTOs, or Management Task Orders, to be mechanized by the RMO are task orders that are used to capture contractor management costs, process improvement costs, non-project-specific training costs, etc. 5.0 Metrics Any metrics associated with this SLP are established and tracked within the NASA IV&V Metrics Program.
CHECK THE MASTER LIST at http://ims.ivv.nasa.gov/ VERIFY THAT THIS IS THE CORRECT REVISION BEFORE USE
7 of 8
Program Execution Plan
Independent Verification & Validation Program 6.0 Records
IVV 09-8 Revision: H Effective Date: February 23, 2009
The following records will be generated and filed in accordance with this SLP and IVV 16, Control of Records, and in reference to NASA Procedural Requirement (NPR) 1441.1, NASA Records Retention Schedules.
Record Name IBD Presentation
Original Vital Y Y
IBD Minutes Budget Execution Plans PEP Timelines
Y
N
Y
N
N
N
Responsible Person Chief of Plans and Programs Chief of Plans and Programs Chief of Plans and Programs Chief of Plans and Programs
Retention Requirement
Location
Destroy when no longer Shared needed or when 5 years old Network Drive whichever is longer. (1230) Destroy when no longer Shared needed or when 5 years old Network Drive whichever is longer. (1230) Destroy when no longer Shared needed or when 5 years old Network Drive whichever is longer. (1230) Destroy when 2 years old. (1/26) Shared Network Drive
CHECK THE MASTER LIST at http://ims.ivv.nasa.gov/ VERIFY THAT THIS IS THE CORRECT REVISION BEFORE USE
8 of 8