Performance Assessment

Document Sample
Performance Assessment Powered By Docstoc
					  Performance Assessment

Assessment of Organizational
       Excellence


     NSF Advisory Committee for
      Business and Operations
             May 5-6, 2005
     Performance Assessment
 Develop and use performance assessment
 tools and measures to provide an
 environment of continuous improvement
 in NSF’s intellectual investments as well
 as its management effectiveness.

(one of four areas—ALL now need to be
  successful)
               Expert Assessments
           Integrated Throughout NSF
                                        Components
                                • Strategic or Long-Term
               NSF Mission        Planning
                                • Scientific Advisory Committee
                                  Reviews
                                • NSF Performance Planning
    OUTCOMES    STRATEGIC
                                • Advisory Committee for GPRA
                                  Performance Assessment
                                  (AC/GPA)
                                • Business & Operations
                                  Advisory Committee
OUTPUT                          • Committees of Visitors (COVs)
               OPERATIONAL
                                • Merit Review
                                • Project Reports
                                • Program Assessment Ratings
                                  Tool (PART)
                INDIVIDUAL
                                • Individual Performance
ACTIVITY
                                  Assessments Directly Linked to
                                  Mission and Goals
                             In red, added 2001 or later
Performance Assessment:
FY 2005 Focus Areas
• PART Activities
  – New Efficiency Metric
  – Highest Ratings in All Programs


• AC/GPA Activities
  – Refined processes
  – Categorizing “Innovative High-Risk”
  PART Activities I
Factors                                Achievements

 New Efficiency                        Reached consensus with OMB and
 Measure: Percent of                   implemented change.
 award decisions made
 available to applicants
 within six months of
 proposal receipt or
 deadline date, while        Results
 maintaining a credible
 and efficient competitive
 merit review system, as
 evaluated by external
 experts.
  PART Activities II
Factors                                    Achievements

 Completed PARTs in three                  100% of NSF PARTs (8 out of 8 in
 NSF Investment Categories                 total) received the highest rating of
 and one Priority Area:                    “Effective” as compared with only
 - Institutions (People)                   15% of 607 PARTs government-
 - Collaborations (People)                 wide.
 - Polar Tools, Logistics, and
   Facilities (Tools)
 - Biocomplexity in the          Results
   Environment (Priority
   Area)
  AC/GPA I
Factors                               Achievements

 Work on individual
                                      - More substantive discussions at
 indicators performed
                                      AC/GPA meeting
 through subgroup chairs
 prior to annual meeting.             -Positive comments from AC/GPA




                            Results
  AC/GPA II
Factors                                     Achievements


                                            - Broad perspectives obtained on
 Identifying “high-risk” and                why NSF-funded projects from
 “multidisciplinary” activities             various disciplines fall into these
                                            categories
                                            -Quality and quantity (~200 for
                                            “high risk” and ~600 for
                                            “multidisciplinary) of program
                                  Results
                                            officer responses
   A STARTING POINT FOR THE AC/GPA DISCUSSION
   ON INNOVATIVE-HIGH RISK RESEARCH – FROM
   PROGRAM OFFICER COMMENTS IN NUGGETS


“Innovative High-Risk”
Forefront, Novel or Transformative but Untried or Untested
High Reward but Significant Technical Challenges and/or High
Probability of Failure
Innovative and Contrary to Current Theory or Conventional
Paradigms


“Other High Risk” (few in number)
Risk from Not Succeeding
Risk to Principal Investigators/Others
                  Performance Assessment: FY 2005
                                                                                                     Coming
 Priority Initiatives                                                       Indicators of          Attractions/
                            Why a Priority      Accomplishments
                                                                              Success              Comments


Identify Appropriate                          Use Measure that          Reached Consensus
Efficiency Measure        Replacement in PART Combines Quality          with OMB                 Effective this year
                                              and Timeliness



                                                4 PARTs completed:
PART Activities           Establishes agency-                           All received the         2 PARTs underway:
                                                - Institutions,
                          wide evaluation                               highest rating:          - Fundamental
                                                - Collaborations,
                          framework.                                    “effective”              Science and
                                                - Polar Tools, and
                                                                                                 Engineering
                                                - Biocomplexity
                                                                                                 - FFRDCs

                                                                                                 Creating of separate
                          Workload issues for   New process well-       -More substantive
Refining AC/GPA                                                                                  OE subgroup
Process                   AC/GPA at annual      received                discussions at
                          meeting                                       AC/GPA meeting
                                                                        -Comments from
                                                                        AC/GPA

                          AC/GPA                Broad perspectives      -Quality and quantity    Definitions and
Identifying “high-risk”
and “multidisciplinary”   Recommendation        obtained on why         (~200 for “high risk”    categories for
activities                                      NSF-funded projects     and ~600 for             “innovative high risk”
                          NAPA
                                                from various            “multidisciplinary) of
                          Recommendation
                                                disciplines fall into   program officer
                                                these categories        responses
                      Initiatives on the Horizon
Future Initiatives     Comments

                       -Complete Fundamental Science and Engineering PART and Federally
  1. PART
                       Funded Research and Development Center PART
                       -Initiate five remaining PARTs for next year


2. “Innovative High    -Work with AC/GPA to define categories for further use (e.g. by COVs, POs in
Risk Research”         writing accomplishments (“nuggets”), input to the NSB Task Force on
                       Transformative Research)
         Conclusion

NSF has demonstrated significant
achievement in Performance
Assessment.

				
DOCUMENT INFO
Shared By:
Categories:
Tags:
Stats:
views:2
posted:8/31/2011
language:English
pages:12