Performance Assessment
Business & Operations Advisory Committee -- March 31, 2004
1
Objectives Statement
Develop and use performance assessment tools and measures to provide an environment of continuous improvement in NSF’s intellectual investments as well as its management effectiveness.
Who? & How?
Advisory Committees (ACs) Committees of Visitors (COVs) NSF Staff
President’s Management Agenda (PMA) Government Performance & Results Act (GPRA) Program Assessment Ratings Tool (PART) Various Other Assessments
B&O AC Meeting – March 2004
2
GAO Report on Program Evaluation
The U.S. General Accounting Office (GAO) identified NSF as one of five federal agencies that successfully demonstrated an evaluative culture with analytical expertise and a commitment to self-examination.
B&O AC Meeting – March 2004
3
Many Assessments Managed at Different Levels
Components
NSF Mission
• Strategic or Long-Term Planning • NSF Performance Planning • Advisory Committee Reviews
OUTCOMES
STRATEGIC
• Advisory Committee for GPRA Performance Assessment (AC/GPA) • Business & Operations Advisory Committee • Committee of Visitors (COV)
OUTPUT
OPERATIONAL
• Merit Review • Project Reports • Program Assessment Ratings Tool
INDIVIDUAL
ACTIVITY
• Individual Performance Assessments
4
B&O AC Meeting – March 2004
Government Performance & Results Act or GPRA (1993)
Government-wide Performance Assessments
President’s Management Agenda or PMA (2001)
Program Assessment Rating Tool or PART (2002)
R&D Investment Criteria (2002)
B&O AC Meeting – March 2004
5
GPRA Performance Planning and Reporting
• 5-year Strategic Plan (‘03-’08) • Annual Performance Plan (in the budget) • Annual Performance Report (45 days after close of FY)
– Performance Highlights
B&O AC Meeting – March 2004
6
GPRA Results
Annual Goal Type Strategic Outcome Goals Management Goals FY99 FY00 FY01 FY02 FY03 100% 75% 80% 100% 100%
5 of 5 6 of 8 4 of 5 4 of 4 4 of 4
67%
15 of 20
60%
18 of 28
61%
15 of 23
74%
18 of 23
63%
14 of 20
FY04 GPRA Goals
Long-Term Strategic Goals People Ideas Annual Goals Increase Award Size Increase Award Duration
Tools
Organizational Excellence
Decrease Dwell Time
+ (by 2006, over 100 PART goals)
7
B&O AC Meeting – March 2004
Strategic Goals – How to Assess?
People Goal – A diverse, competitive, and globally-engaged
U.S. workforce of scientists, engineers, technologists and wellprepared citizens
Ideas Goal - Discovery across the frontier of science and
engineering, connected to learning, innovation and service to society
Tools Goal – Broadly accessible, state-of-the-art S&E
facilities, tools and other infrastructure that enable discovery, learning and innovation
Organizational Excellence Goal - An agile,
innovative organization that fulfills its mission through leadership in state-of-the-art business practices
8
B&O AC Meeting – March 2004
Advisory Committee for GPRA Performance Assessment (AC/GPA)
Scientists, Engineers and Educators (one-third or more from Directorate ACs) COV Project Nuggets Reports Reports Using Indicators: Significant Achievement?
People AC/GPA
B&O AC
Ideas
Tools
Organizational Excellence
AC/GPA Report
B&O AC Meeting – March 2004
9
PMA
Human
S P S = STATUS P = PROGRESS
Capital
Competitive Sourcing
Financial Management EGovernment Budget/ Performance R&D Criteria ???
B&O AC Meeting – March 2004
10
Program Assessment Rating Tool (PART)
• Designed to focus on program performance
• Spreadsheet with questions on purpose, planning, management and performance with goals • Provides a score and effectiveness rating
B&O AC Meeting – March 2004
11
NSF PART Schedule
FY 2005 FY 2006 FY 2007 FY 2008 People Individuals Institutions Collaborations Fundamental S&E Ideas Facilities Polar FFRDCs Tools Priority Areas Nanoscale S&E Info. Tech. Research Biocomplexity Env.
Centers Infrastructure & Instrumentation Workforce for 21st C Capability Enhancements Math. Sciences Human, Social Dyn.
B&O AC Meeting – March 2004
12
NSF FY05 PART Results
FY 2005 People Individuals Ideas Facilities Tools Priority Areas Nanoscale S&E Info. Tech. Research
Government-Wide Results (399 PARTs)
All NSF FY05 PARTs rated Effective (highest rating)
37% 11% 26% Effective Moderately Effective Adequate Ineffective 21% 5%
B&O AC Meeting – March 2004
Results Not Demonstrated 13
Items Planned as References in NSF’s Assessment of This Indicator
1. PART Spreadsheets and Results from OMB
(http://www.whitehouse.gov/omb/budget/fy2005/pma/nsf.pdf and http://www.whitehouse.gov/omb/budget/fy2005/pdf/ap_cd_rom/part.pdf)
2. Performance and Accountability Report
(http://www.nsf.gov/pubs/2004/nsf0410)
3. Performance Highlights Brochure
(http://www.nsf.gov/pubs/2004/nsf04011/)
4. President’s Management Agenda Results
(www.results.gov)
5. Committee of Visitors Reports
(www.nsf.gov/od/gpra/cov.htm)
6. FY05 Performance Budget, GAO Report, etc.
B&O AC Meeting – March 2004
14
Wrap-Up
• Today
– Presented Framework
• Technology Enabled Business Processes – Andrea and Mary • Human Capital Management - Joe • Performance Assessment - Craig
– Get Feedback
• Tomorrow to Mid-May
– NSF to Conduct Assessment
• Mid-May
– Transmit results to B&O Committee
• Early June
– Committee conference call to discuss results – Letter from Committee
• June 22-23, 2004 – AC/GPA Meeting
15
B&O AC Meeting – March 2004