Instructions by HC111123193614

VIEWS: 5 PAGES: 7

									                          Program Level Assessment Spreadsheet Instructions
                                              Applicable to the 2002/2003 Academic Year
                                                            edited: 1/7/2003

Introduction
           The intent of this spreadsheet is to provide a means for each program to present the results of their
           assessment processes in a systematic fashion that is comparable to the reports of all other programs on
           campus.
           This spreadsheet is set up to report the results of both OBJECTIVES and OUTCOMES. As not all programs
           have distinquished between the two (see the the UAA ACIP manual for defintions), your program may chose
           to use only one set of the tables to report your results.
           It is anticipated that the first use of this speadsheet will be somewhat burdansome but that subsequent uses
           will involve a minimum of effort to accomplish the assessment. Please request assistance from the
           Associate Vice Provost for Academic Affairs (AVPAA) in the Office of Academic Affairs if you have questions
           or require assistance in understanding these tables.

           It is assumed that there is within your program sufficient spreadsheet skills to edit the required tables. If you
           have trouble with any part of the spreadsheets please contact the AVPAA for assistance.

           To aid you in filling out this table, comments have been scatter throughout the spreadsheets. You can get rid
           of these by right clicking on the cell the comment is attached to then either hide or delete the comment. We
           have also included sample data from the Civil Engineering program as an example of how the tables are to
           be used. Edit the entries to match your program.
           The edited version of this spreadsheet for each course is to be submitted to the AVPAA by June 1st of each
           year.

Instructions
           When setting up the spreadsheet, change the name of the file to reflect the program that it is being used to
           assess. Please use the same naming convention.

           Edit the information in the upper left hand corner of the sheat tabbed: Obj Results.

                                                             Instructions                                                                     Editing Frequency

                                                     Sheet tab: Obj Results

                                            Table 1: Assessment of Program Objectives

           Published Program Objectives:
                                                                                                                                   Edit ONLY when program objectives in the
           Edit this part of the table to match the program objectives that you have currently listed in your program's          assessment plan change. This should be a rare
           assessment plan. You will probably need to add and delete rows here.                                                   event that includes input from your constituent
                                                                                                                                                      groups.
           Objective Indicators:
                                                                                                                                  Edit ONLY when you add or delete assessment
           Edit this part of the table to match the assessment tools that you have currently listed in your program's             tools in your assessment plan. This should be
           assessment plan. You will probably need to add and delete columns here.                                               done only with input from the program faculty and
                                                                                                                                           possibly the constituent groups.
           Values:

           Values are to be reported on a 0-5 scale. These values are the results of applying your assessment tools.
           The determination of these values is up to the program. The computation of these values are to be              Edit these EVERY YEAR. This is what your tools
           defendable if requested. It is expected that a great amount of work will go into determining these values each         are telling you about performance.
           year. Additional sheets can be added to this workbook if you wish to include the analysis behind the values.

           Weights:

           It is recognized that not all indicators are as significant as others when evaluating performance. The                 This should not change unless your assessment
           "weights" allow you to give different weight to each indicator. In general a "1" should be used for any               tools change or there is a change in opinion of the
           indicator that is a strong indication of performance on a particular objective. A "0.5" should be used for            program faculty concerning the applicability of the
           indicators that are not as strong or are anedotal in nature.                                                                                  tool.

           Current Year Results:
           These cells contain the weighted average of all the tool results for a given objective. Please verify that the
                                                                                                                                 You may need to edit the formula if you changed
           equation is appropriately written. Particularly verify that all tools are accounted for if you added to the list of
                                                                                                                                 the number of tools in the table. Make sure that
           tools. These weighted averages will be mapped to the university objectives and matched with similar results
                                                                                                                                        the formula accounts for all tools.
           from other programs.
           5 Year Trend Data:
           It is important to follow trends, particularly when working with the imprecise data of assessment. This part of        Edit EVERY YEAR, including the data from the
           the table should go back up to five years if you have such data available.                                                         prior assessments

                                                    Sheet Tab: Obj Analysis

                                        Table 2: Analysis of Objective Assessment Results
The purpose of this table is to provide analysis on the meaning of the results listed in Table 1. As an
                                                                                                                      Edit EVERY YEAR. This is section interprets the
alternate, a word processing document can be provided (electronically) that accomplishes the same purpose.
                                                                                                                                  current year's results
 This table gives the program's interpretation of the results and explains the significance of the results.


If an alternate word processing document is used, please provide it in a format compatible with the latest
version of MS Word. The discussion must be made relative to each objective individually. Also include the
resulting numerical value and the target value.


                                         Sheet tab: Outc Results

                                 Table 3: Assessment of Program Outcomes

Published Program Outcomes:
                                                                                                                         Edit ONLY when program outcomes in the
Edit this part of the table to match the program outcomes that you have currently listed in your program's            assessment plan change. This should be a rare
assessment plan. You will probably need to add and delete rows here.                                                   event that includes input from your constituent
                                                                                                                                           groups.
outcome Indicators:
                                                                                                                       Edit ONLY when you add or delete assessment
Edit this part of the table to match the assessment tools that you have currently listed in your program's             tools in your assessment plan. This should be
assessment plan. You will probably need to add and delete columns here.                                               done only with input from the program faculty and
                                                                                                                                possibly the constituent groups.
Values:
Values are to be reported on a 0-5 scale. These values are the results of applying your assessment tools.
The determination of these values is up to the program. The computation of these values are to be              Edit these EVERY YEAR. This is what your tools
defendable if requested. It is expected that a great amount of work will go into determining these values each         are telling you about performance.
year. Additional sheets can be added to this workbook if you wish to include the analysis behind the values.
Weights:
It is recognized that not all indicators are as significant as others when evaluating performance. The                 This should not change unless your assessment
"weights" allow you to give different weight to each indicator. In general a "1" should be used for any               tools change or there is a change in opinion of the
indicator that is a strong indication of performance on a particular outcome. A "0.5" should be used for              program faculty concerning the applicability of the
indicators that are not as strong or are anedotal in nature.                                                                                  tool.
Current Year Results:
These cells contain the weighted average of all the tool results for a given outcome. Please verify that the
                                                                                                                      You may need to edit the formula if you changed
equation is appropriately written. Particularly verify that all tools are accounted for if you added to the list of
                                                                                                                      the number of tools in the table. Make sure that
tools. These weighted averages will be mapped to the university outcomes and matched with similar results
                                                                                                                             the formula accounts for all tools.
from other programs.
5 Year Trend Data:
It is important to follow trends, particularly when working with the imprecise data of assessment. This part of        Edit EVERY YEAR, including the data from the
the table should go back up to five years if you have such data available.                                                         prior assessments

                                        Sheet Tab: Outc Analysis

                             Table 4: Analysis of Outcome Assessment Results
The purpose of this table is to provide analysis on the meaning of the results listed in Table 3. As an
                                                                                                                      Edit EVERY YEAR. This is section interprets the
alternate, a word processing document can be provided (electronically) that accomplishes the same purpose.
                                                                                                                                  current year's results
 This table gives the program's interpretation of the results and explains the significance of the results.

If an alternate word processing document is used, please provide it in a format compatible with the latest
version of MS Word. The discussion must be made relative to each outcome individually. Also include the
resulting numerical value and the target value.


                                     Sheet Tab: Recommendations

                Table 5: Program Improvement Recommendations Based on Assessment
This table is a critical part of the improvement process. After discussing the results of your assessments with
your constituent groups, it is time to recommend improvements to the program. Recommendations need to
be recorded and tracked.                                                                                                           Update EVERY YEAR.

Record all improvement recommendations based on the current year's assessment. Please create an ID for
each improvement recommendation so that it can be tracked. See the format shown in the example given.
This ID tag includes the academic year, college/school abreviation, program abreviation, and
recommendation number. Also indicated the objectives and outcomes that this recommendation addresses.


Also include all prior year recommendations that have not been previously completed. For the
recommendations listed in prior years, indicate the action that was taken to implement the recommendation.
Program Objectives Assessment
        Program     Dental Hygiene
     Department     Dental Programs
  College/School    Community and Technical College
  Academic Year     June 15 2007
 CIP Coordinator    Elizabeth Barnett
                                                                                                                        TABLE 1
                                                                                                            ASSESSMENT OF PROGRAM OBJECTIVES

                                                                                                                                                         Objectives Indicators                                                                               Current Year                                               5 Year Trend Data




                                                                                                                                                        Western Regional Examining
                                                                                                                            ADA National Board Dental




                                                                                                                                                                                     Anesthesia Examination
                                                                                                                                                                                     Western Regional Board
                                                                                                                                                          Board Dental Hygiene
                                                                                                                              Hygiene Examination




                                                                                                                                                                                                                                                Weighted Average
                                                                                                                                                                                                              Employer Survey



                                                                                                                                                                                                                                Alumni Survey




                                                                                                                                                                                                                                                                   Target Value
                                                                                                                                                               Examination




                                                                                                                                                                                                                                                                                   Dufference


                                                                                                                                                                                                                                                                                                2001/2002


                                                                                                                                                                                                                                                                                                            2002/2003


                                                                                                                                                                                                                                                                                                                            2003/2004


                                                                                                                                                                                                                                                                                                                                        2004/2005


                                                                                                                                                                                                                                                                                                                                                    2005/2006


                                                                                                                                                                                                                                                                                                                                                                     2006/2007
                                                         Have technical skills and professional              Value           4.75                            4.75                     4.50                    4.00              4.00            4.75               4.75           0.00          4.75        4.75           4.75         4.75        4.5             4.75
                      Published Program Objectives




                                                     1   demeanor to perform occupationally related
                                                         procedures                                         Weight           1.00                            1.00                     1.00                    0.50              0.50

                                                         Demonstrate academic and clinical                   Value           4.75                            4.75                     4.50                                                      4.75               5.00           -0.25         4.75        5.00           5.00           5         4.67            4.75
                                                     2   proficiency necessary to succeed on national
                                                         and regional examinations                          Weight           1.00                            1.00                     1.00

                                                                                                             Value           5.00                            5.00                     5.00                    4.00              4.00            4.75               4.75           0.00          4.75        4.75           4.75         4.75        4.75            4.75
                                                         Are prepared to perform occupationally
                                                     3
                                                         related procedures in various settings
                                                                                                            Weight           1.00                            1.00                     1.00                    0.50              0.50

                                                                                                             Value           4.75                            4.75                     4.50                    4.00              4.00            4.50               4.75           -0.25         4.50        4.75           4.75         4.75        4.5              4.5
                                                         Meet the occupational requirements of
                                                     4
                                                         employers
                                                                                                            Weight           1.00                            1.00                     1.00                    0.50              0.50
                                                                                              NOTES: Blank and shaded = Tool does not measure this published outcome.
                                                                                                     Values:    Values are reported on a scale of 0-5 (0 = poor, 5 = perfect)
                                                                                                     Weights: 0.5 = Tool gives anecdotal indication of published outcome.
                                                                                                                 1 = Tool is a good measure of the published outcome




Submitted 6-15-07                                                                                                b6ce30c5-cfd0-438d-aac6-37dc7d147efc.xls                                                                                                                                                                                                       Obj Results
Program Objectives Assessment Discussion
       Program    Dental Hygiene
    Department    Dental Programs
 College/School   Community and Technical College
 Academic Year    June 15 2007
CIP Coordinator   Elizabeth Barnett

                                                   TABLE 2
                                  ANALYSIS OF OBJECTIVE ASSESSMENT RESULTS

                  Note: Alternatively, an electronic wordprocessing document compatible with MS Word may be substituted for this table.

                                Objective                 Result     Target                                                                   Discussion
                                                                              The graduating class of 2007 preformed very well on the National Board.The average score was 91%, 6 points above the national
                       Have the technical skills and                          average.This represents a substantial achievement when the principal focus for testing was in case based studies. Critical thinking,a
              1     professional demeanor to perform       4.75       5.00    knowledge of evidenced based research, patient management and appropriate treatment planning skills were outstanding.A new
                    occupationally related procedures                         elective course, advanced dental hygiene case studies, was introduced at the request of the students. Those taking the course felt the
                                                                              class better prepared them for the exam.
                                                                              Our National Board results consistently rank the DH Program in the upper 25% nationally,recent years in the top 10%. The scores
                                                                              indicate that the students are consistently performing at a level of average or above in all areas tested. There are slight fluctuations in
                                                                              individual topic scores from year to year. some reasons for these fluctuations are: student's GPA, faculty changes, test editing
              2
                                                                              discrepancies. Certain courses are traditionally lower scoring due to the level of difficulty of the topics (e.g. microbiology/immunology,
                                                                              oral pathology and pharmacology). Faculty are aware of this and strive continually to enhance these courses.UAA students pass rate
                   Demonstrate academic and clinical                          for the WREB Clinical Exam is generally 100%.
                  proficiency necessary to succeed on      4.75       5.00    Factors influencing the exam results are: student stress level, patient selection/compliance, equipment malfunction, and variable skill
                   national and regional examinations.                        levels Occasionally (3 in 10 years) there are students who need to test a second time which was our experience this year. The written
                                                                              portion of the anesthesia exam must be passed prior to the clinical portion. Therefore, students must be both academically and
                                                                              clinically proficient. In 2007 the Chief Examiner commented he had never known students with better anesthesia skills."They were
                                                                              confident, professional and did extremely well." Our pass rate on these exams indicated that the program is successfully meeting the
                                                                              needs of the students and does not need any adjustments at this time. Please refer to recommendations regarding patient assessment
                                                                              forthe clinical WREB exam results.

                     Are prepared to perform
                                                                              The students are successfully performing the required procedures at the different sites to which they are assigned. Therefore, the
              3 occupationally related procedures in       4.75       4.75
                                                                              program is successfully training the students.
                          various settings


                  Meet the occupational requirements                          The students are successfully performing the required procedures at the different sites to which they are assigned. Therefore, the
              4                                            4.50       4.75
                             of employers.                                    program is successfully training the students.




Submitted 6-15-07                                                                   b6ce30c5-cfd0-438d-aac6-37dc7d147efc.xls                                                                                 Obj Analysis
Program Outcomes Assessment
         Program    Dental Hygiene
      Department    Dental Programs
   College/School   Community and Technical College
  Academic Year     June 15 2007
  CIP Coordinator   Elizabeth Barnett
                                                                                                              TABLE 3
                                                                                                 PROGRAM OUTCOMES ASSESSMENT RESULTS


                                                                                                                                                   Outcomes Indicators                                                                                                     Current Year                                              5 Year Trend Data




                                                                                                                                                                              WREB Dental Hygiene Exam
                                                                                                                                                    ADA Dental Hygiene Exam




                                                                                                                                                                                                         WREB Anesthesia Exam
                                                                                                                           Clinical Competencies




                                                                                                                                                                                                                                External Site Reports



                                                                                                                                                                                                                                                        Weighted Average



                                                                                                                                                                                                                                                                                Target Value




                                                                                                                                                                                                                                                                                                                                        20003/2004
                                                                                                                                                                                                                                                                                                Dufference



                                                                                                                                                                                                                                                                                                             2001/2002



                                                                                                                                                                                                                                                                                                                         2002/2003




                                                                                                                                                                                                                                                                                                                                                     2004/2005



                                                                                                                                                                                                                                                                                                                                                                 2005/2006



                                                                                                                                                                                                                                                                                                                                                                                2006/2007
                                                                                                           Value          4.50                     5.00                       4.50                       5.00                   5.00                    4.80                   5.00            0.20          4.80        5.00          5.00            5         4.75          4.8
                                                       Demonstrate occupationally related skills and
                                                   1
                                                                       concepts
                                                                                                           Weight         1.00                     1.00                       1.00                       1.00                   1.00

                                                                                                           Value          5.00                     5.00                       4.50                       5.00                   5.00                    4.90                   5.00            -0.10         4.90        5.00          5.00            5         4.8           4.9
                                                        Demonstrate critical thinking and problem
                      Published Program Outcomes




                                                   2
                                                                         solving
                                                                                                           Weight         1.00                     1.00                       1.00                       1.00                   1.00

                                                                                                           Value          5.00                     5.00                                                                         5.00                    5.00                                   0.00                                                              4.5              5
                                                                                                                                                                                                                                                                               5.00
                                                   3           Demonstrate professionalism
                                                                                                           Weight         1.00                     1.00                                                                         1.00

                                                                                                           Value          5.00                     5.00                       5.00                       5.00                   5.00                    5.00                   5.00            0.00                                                              4.75             5
                                                       Be employable in a variety of dental hygiene
                                                   4
                                                                         settings
                                                                                                           Weight         1.00                     1.00                       1.00                       1.00                   1.00


                                                   5




                                                   6



                                                                                             NOTES: Blank and shaded = Tool does not measure this published outcome.
                                                                                                    Weights: 0.5 = Tool gives anecdotal indication of published outcome.
                                                                                                                1 = Tool is a good measure of the published outcome




Submitted 6-15-07                                                                                                     b6ce30c5-cfd0-438d-aac6-37dc7d147efc.xls                                                                                                                                                                                                               Outc Results
Program Outcomes Assessment Discussion
         Program    Dental Hygiene
      Department    Dental Programs
   College/School   Community and Technical College
  Academic Year     June 15 2007
  CIP Coordinator   Elizabeth Barnett

                                                       TABLE 4
                                       ANALYSIS OF OUTCOME ASSESSMENT RESULTS

                    Note: Alternatively, an electronic wordprocessing document compatable with MS Word may be substituted for this table.

                                   Objective                  Result    Target                                                                                    Discussion

                                                                                 These students showed excellent clinical/time mgmt skills, therefore it was surprising two failed to pass the clinical WREB exam. One neglected to do so by 0.25
                                                                                 pts.WREB examiners confirmed all areas missed were on one tooth.The quadrant completed was without error. Time management and assessment skills need to be
                                                                                 addressed to ensure this does not happen again.The clinical skills were excellent.The second student also failed by a close margin but lacked the clinical judgment to
                      Demonstrate occupationally related
               1                                               4.80       5.00   assess burnishing.This in turn relates to an inadequate number of heavy calculus patients. It has proven a tremendous challenge to ensure equal clinical experience for
                            skills and concepts
                                                                                 all students.UAA advertised, ran screening clinics, passed out business cards, gave discounts and still we suffered low patient numbers.We will be working diligently with
                                                                                 our scheduling coordinator so there is some provision for this.There is a direct correlation between clinical ability and history with difficult cases.Economic factors might
                                                                                 be involved and our clinic pmt structure may need addressed.External sites may prove valuable.

                                                                                 This in demonstrated by the student performance on national and regional exams and when they are performing the required duties at external sites. Time management
                       Demonstrate critical thinking and                         and clinical assessment skills will be need to be addressed to ensure students adequately judge their time restraints and the type of calculus deposit present. As
               2                                               4.90       5.00
                             problem solving                                     mentioned in prior analysis, scheduling patients who have heavier calculus deposits,maintaining patient compliance to reduce the failed appointment rate, and extensive
                                                                                 advertising through student clincs and screenings should help each student have a successful exam experience.

                                                                                 This was an exceptional class. The students were close knit, helped one another and displayed a positive attitude. They were timely, caring and professional. Good
               3         Demonstrate professionalism           5.00              students overall.More than half the class had employment lined up three months ahead of graduation. Most had multiple job offers and a good response during
                                                                                 interviews with prospective employers.

                                                                                 Half the students worked in a rural clinical setting for a summer community clinical practicum. Community dental health research projects were received with great
                      Be employable in a variety of dental                       enthusiasm. Stakeholders in the agencies were delighted with the great attitude, knowledge and professionalism shown in student presentations. Agencies the students
               4                                               5.00
                              hygiene settings                                   chose for their presentations were Clithroe, ARCH, Hope Community, Assets, Crossroads High School for pregnant teens, and seven classes of fully engaged Colony
                                                                                 High School teenagers.Topics ranged from addictive behaviors to STDs and the systemic relationship to oral healthcare. They are a hard act to follow!

               5
               6                                                                 .




Submitted 6-15-07                                                                                     b6ce30c5-cfd0-438d-aac6-37dc7d147efc.xls                                                                                                   Outc Analysis
Program Improvement Recommendations Based on Assessment
        Program     Dental Hygiene
     Department     Dental Programs
  College/School    Community and Technical College
  Academic Year     June 15 2007
 CIP Coordinator    Elizabeth Barnett


                                                                                     TABLE 5
                                                             PROGRAM IMPROVEMENT RECOMMENDATIONS BASED ON ASSESSMENT

        Item ID                                                Recommendation                                             Objective   Outcome                          Justification                                             Action Taken
                          See discussion under objectives. Because the Dental Hygiene AAS degree is accreditated at
                          a program level, ongoing program improvement is required by the program accrediting
                          agency. Detailed outcomes assessment are required for continuing accreditation and are
                          reported to the program accrediting agency.
                                                                                                                                                  Previously students have been selected based entirely
                          Modify selection criteria to include HOBET test and possible on-site spontaneous written
           1                                                                                                                 1,2         1,2      on GPA. This excludes individuals who may be clinically
                          essay.
                                                                                                                                                  competent hygients.                                       Selection criteria changed effective Fall 2006.
                          Continue to develop external clinical sites to ensure adequate patient selection and                                    To provide students an opportunity to develop clinical
                          experience for all students. Increase number of patient screenings so that students work with                           competencies, and exposure to advanced technologists
           2              appropriate level of difficulty. Include oral health assessment guidelines in seminar to          1,2,3        1,2      available in private practices. State of the art
                                                                                                                                                                                                            Pursuing Memorandum of Agreements with various off-
                          improve patient management skills. Review patient selection guidelines, peer                                            technologies which are not available are available in
                                                                                                                                                                                                            site dental clinics and dental offices within the
                          mentoring.Improve Mock WREB exam w/ possible evaluation by offsite examiners                                            private dental clinics and offices.
                                                                                                                                                                                                            community.
           3                                                                                                                 1,2         1,2




I don't understand this page. SL.




Submitted 6-15-07                                                                                                   b6ce30c5-cfd0-438d-aac6-37dc7d147efc.xls                                                                                            Recommendations

								
To top