Doctoral Program Review Committee
Jerry Thomas (#299), Chair
Evaluators
James R. Morrow, Jr. (#341)
Allen W. Jackson (#428)
AAKPE Doctoral Program Review Committee
(2004-2005)
• Jerry Thomas, Chair
• Kirk Cureton
• Scott Kretchmar
• Gil Reeve
• Waneen Spirduso
The Process
James R. Morrow, Jr. (#341)
"Professional graduate studies is
the supreme problem in physical
education today."
C. W. Hetherington
U.S. News & World Report
Retention
Financial Resources
Graduation Rate
Performance
Faculty Resources
Alumni Giving
Peer Assessment
Student Selectivity
History
• Deliberative process
– Initiated in 1995
– History at www.aakpe.org
• Pilot testing - 1999
– Deborah Feltz led
– Continuous reporting and updating to AAKPE
• Criteria developed
– Austin meeting – 2004
• Data collection – 2000-2004
– Began January 2005
– Ended July 2005
AAKPE Criteria
Student indices
34
Faculty indices
66
Faculty indices – 66%
Visibility
10
30 Productivity
Funding 26
Student indices – 34%
Admissions
4
GA support
7 13
Employment
10
Student quality
AAKPE Criteria – Faculty
• Faculty indices – 66%
– Productivity – 30%
• Research publications – 20%
• Books – 5%
• Presentations – 5%
– Funding – 26%
• Federal – 15%
• Other External – 8%
• Internal – 3%
– Visibility – 10%
• Editorial Boards – 6%
• Number AAKPE Fellows – 2%
• Other Fellow status – 2%
AAKPE Criteria – Student
• Student indices – 34%
– Graduate Assistant support – 13%
– Student quality – 10%
• GRE Verbal – 5%
• GRE Quantitative – 5%
– Employment – 7%
• Postdocs – 4%
• Employment in the field – 3%
– Admissions – 4%
• Selectivity – 2%
• Yield – 2%
AAKPE Process
• List of doctoral programs developed
– Reviewed, confirmed, updated
• Doctoral programs contacted by AAKPE (N = 69)
– 61 different institutions
– Reminders sent
– Second invitation
– Individual contact/recruitment
• FAQs developed and updated
• Data sent to AAKPE from institutions (N = 32)
– Written/signed confirmation
– Verification and review by evaluators
– Attempts to clarify
• Norm-reference system
The Results
Allen W. Jackson (#428)
Faculty Data – By Institution
2000-2004
Index Minimum Maximum
Journal articles 20 574
Books 0 17
Presentations 37 723
Federal funding $0 $18,400,297
External funding (non-Fed) $0 $12,831,114
Internal funding $0 $1,380,290
Editorial Boards 0 58
AAKPE Fellows 0 6
Professional Fellows 0 26
Student Data – By Institution
2000-2004
Index Minimum Maximum
Average GRE – V 413 620
Average GRE – Q 468 723
Student support (FTE) 1.25 52
Selectivity 18% 100%
Yield 47% 100%
Post-doctoral positions 0 15
Positions in field 0 57
Weighting Process
• Variables adjusted
– # faculty, # students enrolled
• Standard scores created
– Outliers restricted to Z = +2.576
– Data were generally positively skewed
– Occasional “problem”
• New program
• “State only” GA support
• Scores adjusted by weighting
• AAKPE – Scale Score created
– Mean = 50
– SD = 10
Correlations Between Faculty Indices and Total Score
2000-2004
Index r
Journal articles (20%) .85
Books (5%) .41
Presentations (5%) .79
Federal funding (15%) .56
External funding (non-Fed) (8%) .40
Internal funding (3%) .33
Editorial Boards (6%) .62
AAKPE Fellows (2%) .50
Professional Fellows (2%) .21
Correlations Between Student Indices and Total Score
2000-2004
Index r
Average GRE – V (5%) .53
Average GRE – Q (5%) .81
Student support (FTE) (13%) .39
Selectivity (2%) .45
Yield (2%) .27
Post-doctoral positions (4%) .48
Positions in field (3%) .09
Correlations Between Number of Faculty and Total Score
2000-2004
Faculty Number r
Total faculty (N) .25
Assistant Professors (n) -.05
Associate Professors (n) .22
Professors (n) .38
The Bottom Line
Jerry Thomas (#299), Chair
Overall Rank and T-score
Rank Institutions T-score
1 Connecticut, Penn St 66
3 Arizona St, Illinois-Champaign, Maryland 63
6 Massachusetts 62
7 Indiana 59
8 Columbia, Oregon St, South Carolina 57
11 Minnesota, Texas A&M 56
13 Texas-Austin 54
14 Georgia 52
15 Houston, Illinois-Chicago, Wisconsin 50
Overall Rank and T-score (con’t)
Rank Institutions T-score
18 Michigan, Michigan St 48
20 Iowa St 47
21 Louisiana St 46
22 Ohio St, West Virginia 43
24 Purdue, North Carolina-Greensboro 42
26 Oklahoma, Utah 41
28 Auburn 40
29 Texas Woman’s 38
30 Mississippi 35
31 Florida St 34
32 North Dakota St 28
Recommendations to the DPRC
• Additional unit descriptors
• Number of graduates
– Development of graduation rate
– Number of years to graduate
• Program contact
– Maintain annual database
• Consider elimination of variables
– Positions in field (.09)
– Professional fellows (.21)
– Yield (.27)
• Review coding directions
– Send FAQs with coding directions
Next Steps
• Reports back to K/PE Doctoral Programs
– Letters to:
• Participants
– Chairs and Deans
• Non-participants
– Chairs and Deans
• Manuscript Development
• News Releases
– Output sites
• Data available
– AAKPE WWW site
• NRC contacts
• 2005-2009 process