VIEWS: 12 PAGES: 7 POSTED ON: 2/19/2010
OVERVIEW OF DOCTORAL PROGRAM EVALUATION PLAN The evaluation of the doctoral program examines the student outcomes in the critical elements of end-of program objectives and quality of the capstone project, the dissertation. The evaluation plan includes the following elements: 1. Student and alumni self-evaluation of the End-of-Program Objectives (See End-of-Program Evaluation Form). 2. Multi-rater evlaution of the capstone project at both the proposal defense and dissertation defense phases. The raters include the dissertation chair, committee members and an outside rater chosen from among the graduate faculty. (See Dissertation Rating Scale). 3. Progress toward outcomes, which includes student's self-evaluation of competencies developed to date 4. Measurement of timeline from comprehensive examination to graduation (See Trajectory). 5. Exit interview, in which the students views of the contribution of the program to the preparation as a researchers are elicited with specification of those elements of the program of greatest and least value to that process. General reactions to the program are also invited. (See Exit Interview) Note: course and faculty evaluation occurs as process components at the end of each course DOCTORAL PROGRAM EVALUATION PLAN ELEMENTS FREQUENCY MEASURE Commparison of VCU SON against AACN doctoral 1 program standards Committee rates; Associate Dean assigns graduate 2 Student Outcomes Proposal defense Dissertation Rating Scale faculty member rater Associate Dean assigns rater; Disssertation Defense Dissertation Rating Scale committee rates Following dissertation 3 Student End of Program defense Exit Interview Associate Dean 4 Progress Toward Objectives Each Semester Progress Toward Objective Scale Student Self Evaluation Time against Student Plan; submit 5 Tracking of Students who are all but dissertation Each Semester copy of dissertation to date Associate Dean Structured Interview plus Open 6 Exit Interview Each Graduate Ended Questions Associate Dean PROGESS TOWARDS DEVELOPMENT OF RESEARCH COMPETENCIES Student's Name___________________________________ Date:___________________ Year/Sem _________ Research skills develop over time, with the guidance of coursework, directed studies and work on your disseration. This scale assumes a developmental model of change in your self- perceved level on selected competences. Measurement will occur at regular intervals Please rate your developing competency, as it is now, on the following skills of a researcher: Scale: A = Very competent B = Competent C = Competent with coaching D = Barely adequate E = Inadequate N/A = Leave BLANK Please select your response to the following statements according to the scale above. 1 Identification of an appropriate, researchable topic A B C D E N/A 2 Recognition of the significance of the study A B C D E N/A 3 Specification of the research question(s) A B C D E N/A 4 Theoretical Specification A B C D E N/A 5 Treatment of philosophical Basis A B C D E N/A 6 Definition of Variables A B C D E N/A 7 Specification of the measurement model A B C D E N/A 8 Review of Literature A B C D E N/A 9 Articulation of Hypotheses or Questions A B C D E N/A 10 Selection of research methods A B C D E N/A 11 Control of Threats to Validity A B C D E N/A 12 Performing the data Analysis A B C D E N/A 13 Reporting the results A B C D E N/A 14 Deriving the conclusions of the study A B C D E N/A 15 Identification of appropriate future studies A B C D E N/A 16 Your overall role competency A B C D E N/A Please add comments. Address any areas of outstanding performance or any areas rated less than "Good". Thank you. RATING OF PROPOSAL/DISSERTATION Student's Name___________________________________ Date:___________________ Rater's role. Please circle: Dissertation chair School member Outside member Faculty observer Please rate the proposal/dissertation on the following elements: Scale: A = Outstanding B = Very Good C = Good D = Adequate E = Inadequate N/A = Leave BLANK Please circle your response to the following statements. 1 Significance of the study A B C D E N/A 2 Specification of the research question A B C D E N/A 3 Treatment of Philosophical Basis A B C D E N/A 4 Definition of Variables A B C D E N/A 5 Theoretical Specification A B C D E N/A 6 Review of Literature A B C D E N/A 7 Appropriateness of Hypotheses or Questions A B C D E N/A 8 Methods A B C D E N/A 9 Control of Threats to Validity A B C D E N/A 10 Data Analysis A B C D E N/A 11 Report of Results A B C D E N/A 12 Identification of appropriate future studies A B C D E N/A 13 Overall strength of proposal/dissertation A B C D E N/A Please add comments. Address any areas of outstanding performance or any areas rated less than "Good". Thank you. End of Program Evaluation by Students Please address your competency in each of the following areas, which are outcomes of the doctoral program. You are asked to first rate your competency and then specifically address your self evaluation and why you rated yourself as you did in the areas indicated below. Please rate the proposal/dissertation on the following elements: A = Outstanding B = Very Good C = Good D = Adequate E = Inadequate N/A = Leave BLANK 1 Apply, transmit and generate knowledge in the disciplline of nursing 2 Construct, test and modify theories for nursing in the context of social, ethical, scientific, cultural and economic influences 3 Analyze and synthezsize knowledge from related disciplines for use in nursing 4 Exhibit scientific integrity in scholarly inquiry 5 Engage in interdisciplinary collaboration in knowledge development and dissemination EXIT INTERVIEW QUESTIONS 1 Tell me about your doctoral program experience 2 Tell me about your dissertation experience 3 How satisfied were you with your doctoral program 4 Regardless of your degree of satisfaction or dissatisfaction, what accounts for your satisfaction 5 Regardless of your degree of satisfaction or dissatisfaction, what accounts for your dissatisfaction 6 What elements of program design or implementation accounted for your time from comps to dissertation completion 7 What would you add/subtract from the program 8 What else would you like to tell me TRAJECTORY FROM COMPS TO COMPLETION OF DOCTORAL PROGRAM Student turns dissertation to date each semester at the time of registration Student's Name Date anticipated Date Completed Appointment of dissertation committee Three chapters approved by chair Three chapters approved by committee IRB approval Proposal defense Number of subjects completed/number planned Last chapters approved by chair Last chapters approved by committee Dissertation Defense Dissertation submitted to graduate program Please identify and explain in detail any barriers you have experienced in the School or University to completion of your dissertation
"Doctoral Progam Evaluation Plan - VCU School of Nursing"