Solid State Energy Conversion Alliance Core Technology Program
September 30 – October 1, 2003 Workshop Peer Review Rating Results Summary Donald Collins
Review Process Summary
Pr Fu oc e es l si ng
Modeling & Simulation
r ate M
C Di ont ag ro no ls st & ic s ials
• Core Technology Project Presentations Power s − Project Objectives & Results Electronic − Non-proprietary Information − Industry, National Lab & University Participation • Verbal & Written Constructive Comments − Written Comments on Peer Review Forms − Industry Verbal Feedback at Workshop • Core Participant Review & Reply to Comments − Reply to Comment Issues • DOE NETL Redirect Projects as Needed
2 of 16
Manufacturing
SECA Core Sep. 2003 Workshop Peer Review Summary - DWC,PM-30,10-09-03
Peer Review Questions
Science & Technology Issues
1. How relevant are the technical issues being addressed in this project?
Objectives & Approach
2.a. If the objectives are fully met, how significant will be the results of this project? 2.b. How effective is the approach in addressing the technical issues of this project?
Results
3.a. How well do the results/progress relate to the project objectives? 3.b. How important are the results of this work in the advancement of the Core Technology area?
Applicability
4. How beneficial are the results of this work in the development efforts of the Industry Teams?
3 of 16
SECA Core Sep. 2003 Workshop Peer Review Summary - DWC,PM-30,10-09-03
Peer Review Rating Scale & Definitions
Not at all – is viewed to be inferior in quality and amount, possibly duplication
of existing work Marginal – provides/likely to provide little useful knowledge or technology advancement Significant – has/will have an influential impact on the core science and technology Superior – is considerable in quantity, quality of advancement of core science and technology Outstanding – marked by eminence and distinction in advancing the state-ofthe-art and/or knowledge in the fields of science and engineering
4 of 16
SECA Core Sep. 2003 Workshop Peer Review Summary - DWC,PM-30,10-09-03
Overall Program Ratings
120 105 100 89 95 98 92 87 76 72 64 60 71 69
80
74
40 27 23 20 12 0 0 1.a 2.a 2.b Review Factor 3.a 3.b 0 0 1 19 29 25 21 17 14 17
38
20
1
2 4.a
Not at All
Marginal
Significant
Superior
Outstanding
5 of 16
SECA Core Sep. 2003 Workshop Peer Review Summary - DWC,PM-30,10-09-03
Overall Program SECA Industry Team Ratings
90 80 73 70 70 63 60 60 50 40 30 22 20 10 10 0 0 1.a 2.a 2.b Review Factor 3.a 3.b 4.a 0 0 1 1 2 12 20 22 19 14 18 12 19 16 57 57 50 61 56 70 77 79
25
Not at All
Marginal
Significant
Superior
Outstanding
6 of 16
SECA Core Sep. 2003 Workshop Peer Review Summary - DWC,PM-30,10-09-03
Overall Program Non-SECA Industry Team Ratings
30 26 25 22 21 20 19 17 15 15 14 13 11 10 7 6 5 5 2 0 0 1.a 2.a 2.b Review Factor 3.a 3.b 4.a 0 0 0 3 3 3 2 1 0 0 1 7 15 13 22 24
Not at All
Marginal
Significant
Superior
Outstanding
7 of 16
SECA Core Sep. 2003 Workshop Peer Review Summary - DWC,PM-30,10-09-03
Overall Program Rating Data
Reviewer Industry Team 1.a 2.a 2.b 3.a 3.b 4.a Sub-Total National Laboratory 1.a 2.a 2.b 3.a 3.b 4.a Sub-Total Factor Totals 1.a 2.a 2.b 3.a 3.b 4.a Rating Totals No Rating 8 17 23 23 21 19 111 No Rating 1 0 2 3 5 6 17 No Rating 9 17 25 26 26 25 128 Not at All 0 0 0 1 1 2 4 Not at All 0 0 0 0 0 0 0 Not at All 0 0 0 1 1 2 4 Marginal 10 12 19 18 22 25 106 Marginal 2 7 6 3 7 13 38 Marginal 12 19 25 21 29 38 144 Significant 70 77 70 79 63 61 420 Significant 19 21 22 26 24 15 127 Significant 89 98 92 105 87 76 547 Superior 73 57 57 50 60 56 353 Superior 22 17 15 14 11 13 92 Superior 95 74 72 64 71 69 445 Outstanding 22 20 14 12 16 19 103 Outstanding 5 3 3 2 1 1 15 Outstanding 27 23 17 14 17 20 118
8 of 16
SECA Core Sep. 2003 Workshop Peer Review Summary - DWC,PM-30,10-09-03
Materials & Manufacturing
70 65 61 60 58 57 54 50 49 45 42 40 38 36 38 48
30
21 20 14 10 9 7 9 15 10 8 5 0 0 1.a 2.a 2.b 3.a 3.b 4.a 0 0 1 1 6 2 7 15
Review Factor
Not at All
Marginal
Significant
Superior
Outstanding
9 of 16
SECA Core Sep. 2003 Workshop Peer Review Summary - DWC,PM-30,10-09-03
Materials & Manufacturing Rating Data
Reviewer Industry Team 1.a 2.a 2.b 3.a 3.b 4.a Sub-Total National Laboratory 1.a 2.a 2.b 3.a 3.b 4.a Sub-Total Factor Totals 1.a 2.a 2.b 3.a 3.b 4.a Rating Totals No Rating 7 11 16 15 13 14 76 No Rating 1 0 1 3 4 5 14 No Rating 8 11 17 18 17 19 90 Not at All 0 0 0 1 1 2 4 Not at All 0 0 0 0 0 0 0 Not at All 0 0 0 1 1 2 4 Marginal 6 6 10 7 11 13 53 Marginal 1 3 5 3 4 8 24 Marginal 7 9 15 10 15 21 77 Significant 36 47 44 50 39 38 254 Significant 13 14 13 15 15 10 80 Significant 49 61 57 65 54 48 334 Superior 44 33 28 27 35 31 198 Superior 14 12 10 9 7 7 59 Superior 58 45 38 36 42 38 257 Outstanding 11 7 6 4 5 6 39 Outstanding 3 2 2 1 1 1 10 Outstanding 14 9 8 5 6 7 49
10 of 16
SECA Core Sep. 2003 Workshop Peer Review Summary - DWC,PM-30,10-09-03
Fuel Processing
18 16 16 16
14
13 12 12 11 10 12 12
12
10
9 8
9
8
6
5 4
5 4 3 2 2 2 4
4
3
2 0 0 1.a 0 0
1 0 2.a 2.b 0 Review Factor 3.a 0 3.b 0 4.a
Not at All
Marginal
Significant
Superior
Outstanding
11 of 16
SECA Core Sep. 2003 Workshop Peer Review Summary - DWC,PM-30,10-09-03
Fuel Processing Rating Data
Reviewer Industry Team 1.a 2.a 2.b 3.a 3.b 4.a Sub-Total National Laboratory 1.a 2.a 2.b 3.a 3.b 4.a Sub-Total Factor Totals 1.a 2.a 2.b 3.a 3.b 4.a Rating Totals No Rating 0 1 1 1 1 0 4 No Rating 0 0 0 0 1 0 1 No Rating 0 1 1 1 2 0 5 Not at All 0 0 0 0 0 0 0 Not at All 0 0 0 0 0 0 0 Not at All 0 0 0 0 0 0 0 Marginal 0 0 3 2 1 1 7 Marginal 0 1 1 0 1 3 6 Marginal 0 1 4 2 2 4 13 Significant 10 12 9 11 10 10 62 Significant 3 4 3 5 2 2 19 Significant 13 16 12 16 12 12 81 Superior 8 7 8 6 6 8 43 Superior 4 2 3 2 3 2 16 Superior 12 9 11 8 9 10 59 Outstanding 5 3 2 3 5 4 22 Outstanding 0 0 0 0 0 0 0 Outstanding 5 3 2 3 5 4 22
12 of 16
SECA Core Sep. 2003 Workshop Peer Review Summary - DWC,PM-30,10-09-03
Modeling & Simulation
20 18 18 16 16 16 15 14 14 12 12 10 10 8 8 7 7 6 6 4 4 3 5 6 8 7 9 9 13 16 19 18 19
2 0 0 1.a 2.a 2.b Review Factor 3.a 3.b 4.a 0 0 0 0 0
Not at All
Marginal
Significant
Superior
Outstanding
13 of 16
SECA Core Sep. 2003 Workshop Peer Review Summary - DWC,PM-30,10-09-03
Modeling & Simulation Rating Data
Reviewer Industry Team 1.a 2.a 2.b 3.a 3.b 4.a Sub-Total National Laboratory 1.a 2.a 2.b 3.a 3.b 4.a Sub-Total Factor Totals 1.a 2.a 2.b 3.a 3.b 4.a Rating Totals No Rating 1 5 5 6 6 4 27 No Rating 0 0 1 0 0 1 2 No Rating 1 5 6 6 6 5 29 Not at All 0 0 0 0 0 0 0 Not at All 0 0 0 0 0 0 0 Not at All 0 0 0 0 0 0 0 Marginal 2 4 4 5 6 7 28 Marginal 1 3 0 0 2 2 8 Marginal 3 7 4 5 8 9 36 Significant 15 9 8 10 9 6 57 Significant 3 3 6 6 7 3 28 Significant 18 12 14 16 16 9 85 Superior 15 12 16 13 12 15 83 Superior 4 3 2 3 1 4 17 Superior 19 15 18 16 13 19 100 Outstanding 6 9 6 5 6 7 39 Outstanding 2 1 1 1 0 0 5 Outstanding 8 10 7 6 6 7 44
14 of 16
SECA Core Sep. 2003 Workshop Peer Review Summary - DWC,PM-30,10-09-03
Power Electronics, Controls & Diagnostics
10 9 9 8 8 7 7 6 6 5 5 4 4 3 2 2 1 1 0 0 1.a 2.a 2.b Review Factor 3.a 3.b 4.a 0 0 0 0 0 0 0 0 0 2 2 2 2 4 4 4 5 5 7
Peer Review Core Tech Workshop Sep. 2003
9 9
Not at All
Marginal
Significant
Superior
Outstanding
15 of 16
SECA Core Sep. 2003 Workshop Peer Review Summary - DWC,PM-30,10-09-03
Power Electronics, Controls & Diagnostics Rating Data
Reviewer Industry Team 1.a 2.a 2.b 3.a 3.b 4.a Sub-Total National Laboratory 1.a 2.a 2.b 3.a 3.b 4.a Sub-Total Factor Totals 1.a 2.a 2.b 3.a 3.b 4.a Rating Totals No Rating 0 0 1 1 1 1 4 No Rating 0 0 0 0 0 0 0 No Rating 0 0 1 1 1 1 4 Not at All 0 0 0 0 0 0 0 Not at All 0 0 0 0 0 0 0 Not at All 0 0 0 0 0 0 0 Marginal 2 2 2 4 4 4 18 Marginal 0 0 0 0 0 0 0 Marginal 2 2 2 4 4 4 18 Significant 9 9 9 8 5 7 47 Significant 0 0 0 0 0 0 0 Significant 9 9 9 8 5 7 47 Superior 6 5 5 4 7 2 29 Superior 0 0 0 0 0 0 0 Superior 6 5 5 4 7 2 29 Outstanding 0 1 0 0 0 2 3 Outstanding 0 0 0 0 0 0 0 Outstanding 0 1 0 0 0 2 3
16 of 16
SECA Core Sep. 2003 Workshop Peer Review Summary - DWC,PM-30,10-09-03