Pops Incorporated

Document Sample
Pops Incorporated Powered By Docstoc
					                                                            DA
                                          ASN (RDA)         HIEF
                                                             YSTEMS
                                   Chief Systems Engineer    NGINEER




     Naval Probability of Program Success (PoPS)
                                      Executive Brief
                                        NDIA / ICPM




          Mr. Carl Siel                   1 June 2009
 ASN(RDA) Chief Systems Engineer
        carl.siel@navy.mil
RDA CHSENG, April 2009
                                                                         DA
                                                                         HIEF
                                      Agenda                              YSTEMS
                                                                          NGINEER


              • Background
                         • DON Acquisition Governance
                         • Core and Naval PoPS
              • PoPS v1.0
                         • Structure
                         • Products and Tools
                            • Guidebook, Handbooks, Visuals, Templates
                         • How used
                            • Individual Program
                            • Portfolio of Programs
                            • Identification of Systemic Issues

              • Gate Review Path Forward



RDA CHSENG, April 2009
                                                                             DA
                 DoN Acquisition Governance                                  HIEF
                                                                              YSTEMS
                                                                              NGINEER

            •       The Secretary of the Navy
                         o With CNO, CMC, ASNRDA, SYSCOM Commanders
                         o Comprehensive review of the Acquisition process
                         o Challenges in Program Planning and Execution.
            •       Enhance the Acquisition Governance process
                         o Inject Early Senior Leadership
                         o Continuous Engagement and Transparency
            •       Increase discipline during each phase of Program Maturity
            •       Codified by SECNAVNOTE on 26 February 2008
            •       Incorporated into SECNAVINST 5000.2D

                               “Two Pass / Six Gate”
RDA CHSENG, April 2009
                                                                   DA
                                                                   HIEF
                    DoN Acquisition Governance                      YSTEMS
                                                                    NGINEER




     •        First Pass - Requirements Establishment
     •        Second Pass - Acquisition Execution
     •        System Design Specification
                •        Capability and Performance Expectations
     •        Gates - Reviews to Assess Readiness to Proceed
                •        Program Health Assessment at each Gate
RDA CHSENG, April 2009
                                                              DA
                                                              HIEF
                         Gate Review Core and PoPS             YSTEMS
                                                               NGINEER




                                            “Core” = Detailed
                                            information germane to
                                            the Gate Decision




                                            “PoPS” = Holistic view
                                            of overall program health
                                            and readiness to proceed


RDA CHSENG, April 2009
                                                                                                  DA
                                                                                                  HIEF
                                      PoPS Background                                              YSTEMS
                                                                                                   NGINEER


       • 19 Jan 2008 PDASN Memo - Interim use of Air Force “PoPS
       Spreadsheet Operations Guide” to Assess Program Health During
       Gate Reviews

       • 6 October 2008 PDASN Memo Naval PoPS Guidance
               • Directed the use of the methods and tools described in the Naval PoPS
                 Guidebook and supplemental Handbooks
                         • Required for all DON Gate Reviews (ACATs I & II)
                         • Shall serve as the standard DON method of representing the health of all
                           ACAT Programs and any other programs subject to the DON Acquisition
                           process

               • Consistent means to assess program health
               • Used any time program health is discussed



RDA CHSENG, April 2009
                                                                         DA
                                                                         HIEF
                                   Agenda                                 YSTEMS
                                                                          NGINEER


                   • Background
                         • DON Acquisition Governance
                         • Core and Naval PoPS
                   • PoPS v1.0
                         • Structure
                         • Products and Tools
                            • Guidebook, Handbooks, Visuals, Templates
                         • How used
                            • Individual Program
                            • Portfolio of Programs
                            • Identification of Systemic Issues

                   • Gate Review Path Forward



RDA CHSENG, April 2009
                                                             DA
                                                             HIEF
                         Leveraging Air Force PoPS            YSTEMS
                                                              NGINEER




                                                DON Interim PoPS
                                                5 Factors
                                                22 Metrics
                                                Subjective Criteria




                                                Naval PoPS 1.0
                                                4 Factors
                                                17 Metrics
                                                More Objective Criteria

                                                            Relocated

                                                            Removed

                                                            Added



RDA CHSENG, April 2009                                                    8
                                                                                                                                  DA
                                                                                                                                  HIEF
                                             Naval PoPS v1                                                                         YSTEMS
                                                                                                                                   NGINEER




          Program
           Health



         4 Factors


        17 Metrics




          Criteria*

                *Notional representation of Criteria. Criteria are Gate- and Metric-specific. The number of Criteria will vary.



RDA CHSENG, April 2009                                                                                                                       9
                         Naval PoPS Criteria      DA
                                                  HIEF
                          (Gate 2 Example)         YSTEMS
                                                   NGINEER

                                               Factor

                                               Metric




                                               Criteria




RDA CHSENG, April 2009                                    10
                                                                                                      DA
                                                                                                      HIEF
                     Naval PoPS Process – R/Y/G Thresholds                                             YSTEMS
                                                                                                       NGINEER



        Criteria Color Thresholds
                    Green = 100% of max score
             G
                    Yellow = 66% of max score
              Y
                    Red = 33% of max score
              R
                                                              Example of Criteria Color Thresholds



        Metric, Factor and Program Health Color Thresholds
                    Green = 80-100% of max score
              G
                    Yellow = 60-<80% of max score
              Y
                    Red = <60% of max score
              R

                                                     Example of Green Threshold for “Parameter Status” Metric




RDA CHSENG, April 2009                                                                                          11
                                                                                                                                                             DA
                                                 Naval PoPS Scoring                                                                                          HIEF
                                                  Gate 2 Example                                                                                              YSTEMS
                                                                                                                                                              NGINEER


     Gate 2                                                                              77.49/100
                                                                                                                                                    G=80-100%
                                                                                                                                                    Y=60-<80%
    G=80-100%
                                                                                                                                                    R=<60%
    Y=60-<80%
    R=<60%                          26.21/40              21.47/23                                  23.85/29                                             5.96/8

   4 Factors


                          17.28/2
                                       2/2     6.93/14   14/14   7.47/9   2.48/5         2.66/3          9/9           .83/1           1.55/2   2.49/3   2.15/3   1.32/2
                             4
   17 Metrics

    G=80-100%
    Y=60-<80%                                                                   2.15/3         3.46/4          .86/1           .86/1
    R=<60%
                         4 pts each    2         7         7       4.5    2.5              1            4.5            0.25             0.66     1.5       0.5      2
     Criteria
   G = 100%                                                                      0.5              0.8          0.2              0.14

    Y = 66%
    R = 33%
RDA CHSENG, April 2009                                                                                                                                                     12
                                                   DA
                         Factor and Metric Level   HIEF
                           Maximum Scores           YSTEMS
                                                    NGINEER




RDA CHSENG, April 2009
                                                                           DA
                                                                           HIEF
                          “Killer Blow” Metrics                             YSTEMS
                                                                            NGINEER


         A Killer Blow is interpreted as a negative situation exists for the
           program of such significance that it must be remedied. .




RDA CHSENG, April 2009                                                            14
                                                                DA
                                Naval PoPS from Tool            HIEF
                         Gate 2 Review without “Killer Blows”    YSTEMS
                                                                 NGINEER




RDA CHSENG, April 2009                                                 15
                                                             DA
                               Naval PoPS from Tool          HIEF
                                                              YSTEMS
                         Gate 2 Review with “Killer Blows”    NGINEER




RDA CHSENG, April 2009                                              16
                                                                                            DA
                                  Naval PoPS Products                                       HIEF
                         Guidebook, Handbook, Visuals and Templates                          YSTEMS
                                                                                             NGINEER

   •       Naval PoPS Guidebook
               o Overview information on Naval PoPS methodology and implementation
   •       Naval PoPS Criteria Handbook and Spreadsheets
               o Complete listing of Program Health Criteria per Gate, per Metric
               o Instructions on completing Program Health Assessments in Criteria
                 Spreadsheets
   •       Naval PoPS Visuals Handbook, Spreadsheets, and Templates
               o Complete set of Program Health Visual Templates for each Gate Review
               o Instructions on creating Visual graphs/charts using Visuals Spreadsheets




RDA CHSENG, April 2009                                                                             17
                                                                              DA
                                How we‟re using PoPS                          HIEF
                                                                               YSTEMS
                                                                               NGINEER

              Individual Program Reviews
                         o Identify matters that affect Program Health

              PEO Portfolio Reviews
                         o Health of all ACATS within a PEO

              Senior Leadership assistance

              Identify Systemic Issues
                         o Action Item Tracking by PoPS Metrics
                         o “Advocates” by PoPS Metrics
                             Establish action teams to address issues with
                               Department implications
RDA CHSENG, April 2009
                                                                                                                             DA
                                                                                                                             HIEF
                                 „Portfolio of Portfolios‟ Approach                                                           YSTEMS
                                                                                                                              NGINEER


        PEO / Team Portfolio                              PEO / Team Portfolio                            PEO / Team Portfolio
         Health Assessment                                 Health Assessment                               Health Assessment


     Pre-Gate 6 Review                                   Gate 6 Sufficiency                              Post-Gate 6 Review
           ACAT Programs                                      Review                                      In-Service Programs
                                                            ACAT Programs
           Program X2 (ACAT _)                                                                               Program X3 (ACAT _)
           Program Y2 (ACAT _)                                                                               Program Y3 (ACAT _)




         Gate 6 Review             Gate 6 Review             Gate 6 Review         Gate 6 Review                 Gate 6 Review


                                                                                                                 Non-Active
      Sub-Portfolio               Sub-Portfolio              Sub-Portfolio        Sub-Portfolio                  Programs
                                                                                                                  Portfolio
         Program X (ACAT _)        Program X1 (ACAT _)       Program A (ACAT _)    Program A1 (ACAT _)           Program XX (ACAT _)
         Program Y (ACAT _)        Program Y1 (ACAT _)       Program B (ACAT _)    Program B1 (ACAT _)
                                                             Program C (ACAT _)    Program C1 (ACAT _)




         Each program within a sub portfolio will complete a PoPS Gate 6 Program Health Assessment.

RDA CHSENG, April 2009
                                                               DA
                                                               HIEF
                         PEO / Team Overall Portfolio Health    YSTEMS
                                                                NGINEER




RDA CHSENG, April 2009
                                                                              DA

                         Systemic Issue Advocates                             HIEF
                                                                               YSTEMS
                                                                               NGINEER


              Acquisition Management–            Government – DASN C4I
               Principal Civilian DASN (PCD)
                                                  Program Advocacy – DASN C4I
              Manning – PCD
                                                  Scope Evolution – DASN M&B
              Contract Execution DASN A&LM        with Product DASNs
              Industry / Company Assessment      Parameter Status – RDA CHSENG
               – DASN AIR and SHIPS/IWS)
                                                  T&E – DON T&E Executive
              Sustainment – DASN A&LM
                                                  Technical Maturity – RDA
              Interdependencies – DASN C4I        CHSENG
              Budget – DASN M&B and EXW          Naval POPS – RDA CHSENG
              Cost Estimating – ASN FMB          NOTPOPS Other – RDA CHSENG
              CONOPS – OPNAV / HQMC              NOTPOPS Life Cycle Costs –
                                                   DASN A&LM



RDA CHSENG, April 2009
                                                                      DA
                                                                      HIEF
                                     Agenda                            YSTEMS
                                                                       NGINEER


         • Background
                 • DON Acquisition Governance
                 • Core and Naval PoPS
         • PoPS v1.0
                 • Structure
                 • Products and Tools
                         • Guidebook, Handbooks, Visuals, Templates
                 • How used
                    • Individual Program
                    • Portfolio of Programs
                    • Identification of Systemic Issues

         • Gate Review Path Forward



RDA CHSENG, April 2009
                                                                                                DA
                                  Gate Review Update                                            HIEF
                                                                                                 YSTEMS
                                                                                                 NGINEER

           Align Gates to the new DODI 5000.02
                                                 Post-IBR   Post-CDR   CPD
                         1    2      3   4   5      6          6       6        6


         New
     DoDI 5000.02
      (Dec 2008)


           Reassess Core Entrance / Exit and Program Health Criteria
           Functional Sub Groups addressing emergent initiatives
           o Sustainment                 o T&E                               o Risk Management
           o TOC                         o Open Architecture                 o Configuration Steering
           o Cost Estimating                                                   Board
                                         o Technology Protection
             For each, determine needed revisions to
                o Entrance and Exit Criteria
                o Core Templates
                o Program Health Criteria and Templates
RDA CHSENG, April 2009
                                                                                                           23
                                                                         DA
                                                                         HIEF
                   Gate Review Core and Program Health                    YSTEMS
                                                                          NGINEER




     •        The Gate Review process is being used and updated to:
                o Inject Senior Leadership early
                o Ensure continuous engagement and transparency
                o Increase discipline during each phase of Program Maturity

RDA CHSENG, April 2009
                                      DA
                                      HIEF
                                       YSTEMS
                                       NGINEER




                         Questions?




RDA CHSENG, April 2009

				
DOCUMENT INFO
Description: Pops Incorporated document sample