Instructions - University of Alaska Anchorage

Document Sample
Instructions - University of Alaska Anchorage Powered By Docstoc
					                    Program Level Outcome Assessment Spreadsheet Instructions
                                             Applicable to the 2002/2003 Academic Year
                                                    Version 0.1 edited: 2/14/2003

Introduction
           The intent of this spreadsheet is to provide a means for each program to present the results of their
           assessment processes in a systematic fashion that is comparable to the reports of all other programs on
           campus.
           It is anticipated that the first use of this spreadsheet will be somewhat burdensome but that subsequent uses
           will involve a minimum of effort to accomplish the assessment. Please request assistance from the Associate
           Vice Provost for Academic Affairs (AVPAA) in the Office of Academic Affairs if you have questions or require
           assistance in understanding these tables.

           It is assumed that there are within your program sufficient spreadsheet skills to edit the required tables. If you
           have trouble with any part of the spreadsheets please contact the AVPAA for assistance.

           To aid you in filling out this table, comments have been scattered throughout the spreadsheets. You can get
           rid of these by right clicking on the cell the comment is attached to then either hiding or deleting the comment.
           We have also included sample data from the Civil Engineering program as an example of how the tables are
           to be used. Edit the entries to match your program.
           The edited version of this spreadsheet for each course is to be submitted to the AVPAA by June 1st of each
           year.

Instructions
           When setting up the spreadsheet, change the name of the file to reflect the program that it is being used to
           assess. Please use the same naming convention.

           Edit the information in the upper left hand corner of the sheet tabbed: Outc Results.

                                                            Instructions                                                                    Editing Frequency

                                                   Sheet tab: Outc Results

                                           Table 1: Assessment of Program Outcomes

           Published Program Outcomes:
                                                                                                                                   Edit ONLY when program outcomes in the
           Edit this part of the table to match the program outcomes that you have currently listed in your program's           assessment plan change. This should be a rare
           assessment plan. You will probably need to add and delete rows here.                                                  event that includes input from your constituent
                                                                                                                                                     groups.
           Outcome Indicators:
                                                                                                                                 Edit ONLY when you add or delete assessment
           Edit this part of the table to match the assessment tools that you have currently listed in your program's            tools in your assessment plan. This should be
           assessment plan. You will probably need to add and delete columns here.                                              done only with input from the program faculty and
                                                                                                                                         possibly the constituent groups.
           Grade:
           This is the "grade" that your assessment tool would indicate for performance relative to the associated
           outcome. In some cases, this grade can be determined by some computational procedure that compares the
                                                                                                                                Edit these EVERY YEAR. This is what your tools
           results of the assessment to some expected performance value. In many cases, this will be a judgment call
                                                                                                                                        are telling you about performance.
           by the program faculty based on what they are seeing in the data and/or experience that came out of the
           application of the indicated assessment process.
           The grades enter into the spreadsheet should meet the standard listed as follows:
           A = Honor grade; indicates comprehensive mastery of the outcome. Performance is exemplary. There is no
           way to improve performance on this outcome.
           B = Indicates a high level of performance in meeting the outcome. Performance is more than acceptable but
           is not exemplary.
           C = Indicates a satisfactory level of performance in meeting the outcome. Performance relative to this
           outcome meets minimum standards.
           D = Indicates that some level of performance has been achieved but that the level achieved is not acceptable.
           F = Indicates failure to achieve this outcome in any reasonable sense.
           NG = No Grade. The assessment tools are not used to measure the associated outcome.

           Plus and Minuses may be added to the grades to indicate degrees of accomplishment.

           NOTE: A grade MUST be assigned to each cell or an error will result. All grades are upper case and
           without spaces before, within, or after.

           Values:

           The values entered here correspond the the grades entered on the line above. The scale is a 4.0 scale. The
                                                                                                                                These are automatically computed values. There
           associated values are: A = 4.0, B = 3.0, C = 2.0, D = 1.0, F = 0.0. A PLUS adds 0.3 to the grade value. A
                                                                                                                                              is no need to edit.
           MINUS subtracts 0.3 from the grade value.
Weights:
It is recognized that not all indicators are as significant as others when evaluating performance. The
"weights" allow you to give different weight to each indicator. In general a "1" should be used for any indicator
that is a strong indication of performance on a particular outcome. A "0.5" should be used for indicators that    This should not change unless your assessment
are not as strong or are anecdotal in nature. For example, if your assessment tool did not return good results tools change or there is a change in opinion of the
for reasons such as low return, it did not measure accurately for some reason, or any other reason that makes program faculty concerning the applicability of the
the results suspect or of lesser value, you should enter a 0.5 for that measurement. If you have a high degree                         tool.
of confidence in the correlation between the results of the assessment and the associated outcome then enter
a 1.0.
Current Year Results:

These cells contain the weighted average of all the tool results for a given outcome. Particularly verify that all These are automatically computed values. There
tools are accounted for if you added to the list of tools. These weighted averages will be mapped to the           is no need to edit unless columns were added that
university outcomes and matched with similar results from other programs.                                                  do not appear in final computation.

5 Year Trend Data:
It is important to follow trends, particularly when working with the imprecise data of assessment. This part of    Edit EVERY YEAR, including the data from the
the table should go back up to five years if you have such data available.                                                     prior assessments

                                      Sheet Tab: Outc Analysis

                            Table 2: Analysis of Outcome Assessment Results
The purpose of this table is to provide analysis on the meaning of the results listed in Table 1. As an
                                                                                                                  Edit EVERY YEAR. This is section interprets the
alternate, a word processing document can be provided (electronically) that accomplishes the same purpose.
                                                                                                                              current year's results
This table gives the program's interpretation of the results and explains the significance of the results.

If an alternate word processing document is used, please provide it in a format compatible with the latest
version of MS Word. The discussion must be made relative to each outcome individually. Also include the
corresponding resulting numerical value and grade from table.


                                   Sheet Tab: Recommendations

                 Table 3: Program Improvement Recommendations Based on Assessment
This table is a critical part of the improvement process. After discussing the results of your assessments with
your constituent groups, it is time to recommend improvements to the program. Recommendations need to
be recorded and tracked.                                                                                                      Update EVERY YEAR.
Record all improvement recommendations based on the current year's assessment. Identify the outcomes
that the improvement recommendation is intended to enhance. Some rationale for the proposed action is
suggested to tie the recommendation to the issues discussed in Table 2.
State the resource implications associated with each suggestion.

Also include all prior year recommendations that have not been previously completed. For the
recommendations listed in prior years, indicate the action that was taken to implement the recommendation.
               Program Outcomes Assessment
                           Program    Elementary Education
                        Department    Teaching and Learning
                     College/School   College of Education
                    Academic Year     2006
                    CIP Coordinator   Kate O'Dell
                                                                                                                                                     TABLE 1
                                                                                                                                    PROGRAM OUTCOMES ASSESSMENT RESULTS



                                                                                                                                                                                                                                                                                                        Current
                                                                                                                                                                                                                                                                                                         Year




                                                                                                                                                                                           Methods Course Grades




                                                                                                                                                                                                                                            Candidate Work Sample
                                                                                                                                                                                                                   Internship Evaluation
                                                                                                                                                                      Foundations Course




                                                                                                                                                                                                                                                                                                          Weighted Average
                                                                                                                                                                                                                                                                                      Employer Survey
                                                                                                                                                                                                                                                                    Graduate Survey
                                                                                                                                                                                                                                                Folio/Portfolio
                                                                                                                                                          Praxis II




                                                                                                                                                                           Grades




                                                                                                                                                                                                                                                                                                                             2004



                                                                                                                                                                                                                                                                                                                                    2005



                                                                                                                                                                                                                                                                                                                                           2006
                                                                                                                                          Grade                            A-              B+                      A-                             A-                NG                NG                  B+
                                                                                    Can describe a philosophy of education and
                                                                               1    demonstrate its relationship to practice (AK          Value                        3.70                3.30                    3.70                      3.70                                                         3.59               3.24   3.36   3.59
                                                                                              Standard I: Philosophy
                                                                                                                                          Weight                       0.50                1.00                    1.00                      1.00

                                                                                                                                          Grade                            A-              A-                      A-                             A-                NG                NG                  A-
                                                                                   Understands how students learn and applies
                                                                               2     this knowledge in teaching practice. (AK             Value                        3.70                3.70                    3.70                      3.70                                                         3.70               2.3    3.59   3.7
                                                                                    Standard II: Learning Theory and Practice)
                                                                                                                                          Weight                       0.50                1.00                    1.00                      1.00
                                        Published ProgramObjectives/Outcomes




                                                                                                                                          Grade                            A-              A-                      A-                             A-                NG                NG                  A-
                                                                                       Teaches students with respect for their
                                                                               3     individual and cultural characteristics. (AK         Value                        3.70                3.70                    3.70                      3.70                                                         3.70               2.3    3.36   3.7
                                                                                                Standard III: Diversity)
                                                                                                                                          Weight                       0.50                1.00                    1.00                      1.00

                                                                                                                                          Grade           A-              B+               A-                         A                           A-                NG                NG                  A-
                                                                                   Knows the appropriate subject matter content
                                                                               4      and how to teach it. (AK Standard IV:               Value          3.70          3.30                3.70                    4.00                      3.70                                                         3.72               3.33   3.7    3.72
                                                                                                    Content)
                                                                                                                                          Weight         1.00          0.50                1.00                    1.00                      1.00

                                                                                                                                          Grade                           B+                  A                    A-                             A-                NG                NG                  A-
                                                                                    Facilitates, monitors, and assesses student
                                                                               5     learning. (AK Standard V: Instruction and            Value                        3.30                4.00                    3.70                      3.70                                                         3.73               3.13   3.61   3.73
                                                                                                   Assessment)
                                                                                                                                          Weight                       0.50                1.00                    1.00                      1.00

                                                                                   Creates and maintains a learning environment           Grade                           B+               B+                      A-                           B+                  NG                NG                  B+
                                                                                   in which all students are actively engaged and
                                                                               6                                                          Value                        3.30                3.30                    3.70                      3.30                                                         3.43               2.2    3.33   3.43
                                                                                      contributing members. (AK Standard VI:
                                                                                                Learning Environment)                     Weight                       0.50                0.50                    1.00                      1.00

                                                                                                                                          Grade                             B              C+                         B                            B                NG                NG                  B-
                                                                                   Works as a partner with parents, families, and
                                                                               7   the community. (AK Standard VII: Family and            Value                        3.00                2.30                    3.00                      3.00                                                         2.86               3.08   2.6    2.86
                                                                                            Community Involvement)
                                                                                                                                          Weight                       0.50                0.50                    1.00                      0.50

                                                                                                                                          Grade                           B+                  B                    B-                             B-                NG                NG                    B
                                                                                   Participates in and contributes to the teaching
                                                                               8                                                          Value                        3.30                3.00                    2.70                      2.70                                                         2.93               2.29   2.73   2.93
                                                                                   profession. (AK Standard VII: Professionalism)
                                                                                                                                          Weight                       0.50                0.50                    1.00                    0.53.36


                                                                                                                                     Blank and shaded = Tool does not measure this published outcome.
                                                                                                                                     Weights: 0.5 = Tool gives anecdotal indication of published outcome.
                                                                                                                                                  1 = Tool is a good measure of the published outcome


Submitted 6-15-07                                                                                                                       38db99aa-8a73-442b-8faf-9903c901993b.xls                                                                                                                                                                  Outc Results
 Program Outcomes Assessment Discussion
         Program    Elementary Education
      Department    Teaching and Learning
   College/School   College of Education
  Academic Year     2006
  CIP Coordinator   Kate O'Dell

                                                      TABLE 2
                                      ANALYSIS OF OUTCOME ASSESSMENT RESULTS

                    Note: Alternatively, an electronic word-processing document compatible with MS Word may be substituted for this table.

                                   Outcome                      Result                                                                             Explanation of the Results
                                                                         We used grades from specific courses to indicate acquisition of certain skills related to Outcome 1. We also used the quality of work done by Candidates, as described in
                 Can describe a philosophy of education                  the course content guides and syllabi for these courses. Additional information is provided by a review of Internship Evaluations and course grades* for Internship I and II.
               1   and demonstrate its relationship to           B+      The Candidate Work Sample Folio/Portfolio includes Standards-Based Assessments (SBAs) that measure an Intern's work with Rubrics created to address the indicators
                  practice (AK Standard I: Philosophy                    for Alaska State Standards for Teachers and those for ACEI, the Association for Childhood Education International. Results that indicate progress can be attributed to a
                                                                         more organized, standardized process for defining program requirements for Interns and more systematic collection of the data.

                                                                         We used grades from specific courses to indicate acquisition of certain skills related to Outcome 2. We also used the quality of work done by Candidates, as described in
                     Understands how students learn and
                                                                         the course content guides and syllabi for these courses. Additional information is provided by a review of Internship Evaluations and course grades* for Internship I and II.
                      applies this knowledge in teaching
               2                                                 A-      The Candidate Work Sample Folio/Portfolio includes Standards-Based Assessments (SBAs) that measure an Intern's work with Rubrics created to address the indicators
                      practice. (AK Standard II: Learning
                                                                         for Alaska State Standards for Teachers and those for ACEI, the Association for Childhood Education International. Results in the current report that indicate progress can
                             Theory and Practice)
                                                                         be attributed to a more organized, standardized process for defining program requirements for Interns and more systematic collection of the data.

                    Teaches students with respect for their
                                                                         Primary data for this outcome are a review of Internship Evaluations, course grades* for Internship I and II, and course grades* for EDFN A300 and EDFN A303. In
               3     individual and cultural characteristics.    A-
                                                                         addition, we have formal and standardized data collection from Internship Evaluation and SBAs from the Candidate Work Sample Folio/Portfolio.
                           (AK Standard III: Diversity)
                                                                         Praxis II scores indicate that the average for the 2006 Intern cohort was toward the upper part of the national average performance range. Our program "grade" for the
                     Knows the appropriate subject matter
                                                                         Praxis II test is lower this year because we are recognizing that the test does not assess content knowledge in all of the elementary education areas as defined by ACEI.
               4       content and how to teach it. (AK          A-
                                                                         Furtherrmore, faculty know that one standardized test cannot measure something as complex as content knowledge. Therefore, additional data are collected from
                            Standard IV: Content)
                                                                         Internship Evaluation, SBAs, and methods course grades*.
                      Facilitates, monitors, and assesses
                                                                         Primary data for this outcome are a review of Internship Evaluations, course grades* for Internship I and II, and methods course grades*. In addition, we have formal and
               5       student learning. (AK Standard V:         A-
                                                                         standardized data collection from Internship Evaluation and SBAs included in the Candidate Work Sample Folio/Portfolio.
                          Instruction and Assessment)
                       Creates and maintains a learning
                     environment in which all students are
                                                                         This outcome is primarily assessed through the Candidate Folio/Portfolio and the Internship Evaluations. Results that indicate changes in the program "grade" can be
               6       actively engaged and contributing         B+
                                                                         attributed to a more organized, standardized process for defining program requirements for interns and more systematic collection of the data.
                     members. (AK Standard VI: Learning
                                  Environment)
                       Works as a partner with parents,
                                                                         This outcome is primarily assessed through the Candidate Folio/Portfolio and the Internship Evaluations. Results that indicate changes in the program "grade" can be
                       families, and the community. (AK
               7                                                 B-      attributed to a more organized, standardized process for defining program requirements for interns and more systematic collection of the data. Additionally, our mentor and
                     Standard VII: Family and Community
                                                                         Clinical Faculty training has helped insure that Interns are encouraged earlier and more systematically to address this standard.
                                   Involvement)
                  Participates in and contributes to the                 This outcome is primarily assessed through the Candidate Folio/Portfolio and the Internship Evaluations. Results that indicate changes in the program "grade" can be
               8 teaching profession. (AK Standard VII:          B-      attributed to a more organized, standardized process for defining program requirements for interns and more systematic collection of the data. Additionally, our mentor and
                            Professionalism)                             Clinical Faculty training has helped insure that Interns are encouraged earlier and more systematically to address this standard.
                                                                         NOTE: One assessment that yields data for each of the outcomes is whether a graduate receives the Institutional Recommendation (IR) for a teacher license
                                                                         awarded by the UAA College of Education. Unless a candidate passes all courses, meets all of the Alaska Standards for Teachers and successfully completes
                                                                         all of the Standards-Based Assessments and program requirements, s/he will not receive an IR.
                                                                         *Note: When "course grades" are used as data points, faculty have chosen specific courses because the CCGs and syllabi include assignments and/or projects that
               9                       0
                                                                         address the standard(s) being measured.
              10                       0
              11                       0
              12                       0




Submitted 6-15-07                                                                                     38db99aa-8a73-442b-8faf-9903c901993b.xls                                                                                              Outc Analysis
 Program Improvement Recommendations Based on Assessment
         Program    Elementary Education
      Department    Teaching and Learning
   College/School   College of Education
   Academic Year    2006
  CIP Coordinator   Kate O'Dell

                          This report will be submitted as a separate Word file.
                                                                                   TABLE 3
                                                           PROGRAM IMPROVEMENT RECOMMENDATIONS BASED ON ASSESSMENT

         Rec. No.                                          Recommendation                       Outcome(s)            Rationale for the Recommendation      Resource Implications   Action Taken
            1             See recommendations word file.

            2

            3

            4

            5

            6

            7

            8

            9

            10

            11

            12

            13

            14

            15

            16

            17

            18

            19

            20

            21

            22

            23

            24

            25

            26




Submitted 6-15-07                                                                                                38db99aa-8a73-442b-8faf-9903c901993b.xls                                          Recommendations
Grade Table
     A         4     0    F
    A-        3.7   0.2   F+
     B         3    0.7   D-
    B-        2.7   0.9   D
    B+        3.3   1.2   D+
     C         2    1.6   C-
    C-        1.7   1.9   C
    C+        2.3   2.2   C+
     D         1    2.6   B-
    D-        0.7   2.9   B
    D+        1.3   3.2   B+
     F         0    3.6   A-
    F+        0.3   3.9   A
    NG

				
DOCUMENT INFO
Shared By:
Categories:
Tags:
Stats:
views:7
posted:8/8/2011
language:English
pages:6