CTC Dental Hygiene AAS Assessment Final Report 6.10 - Quimby

Document Sample
CTC Dental Hygiene AAS Assessment Final Report 6.10 - Quimby Powered By Docstoc
					Program Outcomes Assessment
               Program    Dental Hygiene
            Department    Division of Allied Health
         College/School   Community and Technical College
         Academic Year    2010

 Assessment Coordinator Sandra Pence
                                                                         TABLE 1
                                                               PROGRAM MISSION AND CONTEXT




                                                                        Program Mission




 The mission of the UAA Dental Hygiene Program is to educate students in dental hygiene to the Associate of Applied Science
           degree level. The educational objectives of the Dental Hygiene Program are to produce graduates who:
            1. Have the technical skills and professional demeanor to perform occupationally-related procedures.
       2. Demonstrate academic and clinical proficiency necessary to succeed on national and regional examinations.
                       3. Are prepared to perform occupational-related procedures in various settings.
                                     4. Meet the occupational requirements of employers.



                                                            Program Context and General Comments


   To become licensed in dental hygiene in the State of Alaska, students must graduate from an American Dental Association
     (ADA) accredited dental hygiene program. The ADA has specific accreditation standards that must be met to maintain
   accreditation status. The UAA Dental Hygiene Program went through accreditation renewal in 2007 and received approval
                                                without reporting requirements.

                                                                Location of Published Outcomes



                   The UAA Dental Hygiene Program's competencies (outcomes) are listed on the Program's website.



  Submitted Month/Day/Year                                  32106e5c-8bfc-48bc-a032-6c759d801da8.xlsx              Mission & Context
                           Program Outcomes Assessment
                                  Program                                     Dental Hygiene
                                Department                                    Division of Allied Health
                               College/School                                 Community and Technical College
                               Academic Year                                  2010
                           Assessment Coordinator                             Sandra Pence
                                                                                                                                                      TABLE 2
                                                                                                                                        PROGRAM OUTCOMES ASSESSMENT RESULTS
                                                                                                                                                                                                                                                                                                                                          Current
                                                                                                                                                                                                                     Measures                                                                                                                                            5 Year Data Trend
                                                                                                                                                                                                                                                                                                                                           Year




                                                                                                                                                                                                                                                                                                                Community projects
                                                                                                                                        Written examination




                                                                                                                                                                                                                                                                                         ADHA Membership




                                                                                                                                                                                                                                                                                                                                          Weighted Average
                                                                                                                                                                     Case presentation




                                                                                                                                                                                                                      Literature review
                                                                                                                                                                                              Professionalism




                                                                                                                                                                                                                                                                   Record keeping
                                                                                                                                                                                                                                               Competencies




                                                                                                                                                                                                                                                                                                                                           automatically)
                                                                                                                                                                                                                                                                                                                                             (Calculates



                                                                                                                                                                                                                                                                                                                                                             2006/2007

                                                                                                                                                                                                                                                                                                                                                                           2007/2008

                                                                                                                                                                                                                                                                                                                                                                                       2008/2009

                                                                                                                                                                                                                                                                                                                                                                                                   2009/2010

                                                                                                                                                                                                                                                                                                                                                                                                               2010/2011
                                                                                                                                                                                                   grade




                                                                                                                                                                                                                                                                       grade
                                                                                                                                                                25




                                                                                                                                                                                         25




                                                                                                                                                                                                                25




                                                                                                                                                                                                                                          11




                                                                                                                                                                                                                                                              25




                                                                                                                                                                                                                                                                                    25




                                                                                                                                                                                                                                                                                                           25




                                                                                                                                                                                                                                                                                                                                     11
                                                                                                                               Grade       A                            A                       NG                    NG                       NG                    NG                  NG                     NG                             B+
                                                                               Provide dental hygiene care in a legal and
                                                                         1                                                     Value   4.00                      0   3.00                0                      0                         0                   0                     0                      0                         0       3.50                            4           4           4         3.5
                                                                                            ethical manner.
                                                                                                                               Weight 1.00                           1.00                       NG                    NG                       NG                    NG                  NG                     NG
                                                                                                                               Grade    NG                           NG                           B-                  NG                       NG                    NG                  NG                     NG                              B
                                                                              Exhibit professional behavior, including time
                                                                         2    management, risk management, and respect         Value                             0                       0    3.00              0                         0                   0                     0                      0                         0       3.00                            4           4         2.7           3
                                                                                       of patients and co-workers.
                                                                                                                               Weight NG                             NG                       1.00                    NG                       NG                    NG                  NG                     NG
                                                                                                                               Grade    NG                           B+                         NG                      C                      B-                    NG                  NG                     NG                             C+
                                                                               Acquire, synthesize, and critically analyze
                                  Published ProgramObjectives/Outcomes




                                                                         3      information in a scientific and effective      Value                             0   3.30                0                      0    2.00                 0    2.70           0                     0                      0                         0       2.67                            4           3         2.67 2.67
                                                                                                manner.
                                                                                                                               Weight NG                             1.00                       NG                   1.00                      1.00                  NG                  NG                     NG
                                                                                                                               Grade    B+                              A                       NG                    NG                         B                   NG                  NG                     NG                             B+
                                                                                Collect, analyze, and record data on the
                                                                         4                                                     Value   3.30                      0   4.00                0                      0                         0    3.00           0                     0                      0                         0       3.43                            4         3.5         3.43 3.43
                                                                               general and oral health status of patients.
                                                                                                                               Weight 1.00                           1.00                       NG                    NG                       1.00                  NG                  NG                     NG
                                                                               Use critical decision making skills to develop Grade  B                               B+                         NG                    NG                         B                   NG                  NG                     NG                             C+
                                                                              a dental hygiene diagnosis, which will provide
                                                                                a basis for interventions that are within the Value 2.30                             3.00                                                                      2.30                                                                                          2.53                            4         3.7         3.1         3.1
                                                                         5                                                                                       0                       0                      0                         0                   0                     0                      0                         0
                                                                                   scope of dental hygiene practice and
                                                                              determine the need for referral to appropriate Weight 1.00                             1.00                       NG                    NG                       1.00                  NG                  NG                     NG
                                                                                      health professions as needed.
                                                                              Formulate an oral health care plan, including    Grade       B                            B                       NG                    NG                         B                   NG                  NG                     A-                             C+
                                                                                   a planned sequence of educational,
                                                                         6     preventive, and therapeutic services based      Value   3.00                          2.30                0                      0                         0    2.30           0                     0                      0    3.00                 0       2.65                          3.5         3.33 3.18 3.18
                                                                                    on the dental hygiene diagnosis in
                                                                                 collaboration with the patient and other      Weight 1.00                           1.00                       NG                    NG                       1.00                  NG                  NG                     1.00
                                                                                          health care providers.
                                                                                Deliver preventive and therapeutic care to     Grade    NG                           A-                         NG                    NG                       B-                    NG                  NG                     A-                              A-
                                                                                achieve and maintain oral health utilizing     Value                                 3.70                                                                      3.70                                                             3.70                         3.70                            4         3.67 3.37 3.37
                                                                         7                                                                                       0                       0                      0                         0                   0                     0                      0                         0
                                                                              established infection control procedures, pain
                                                                               control measures, and ergonomic practices.      Weight NG                             1.00                       NG                    NG                       1.00                  NG                  NG                     1.00

                                                                                                                               Grade    NG                           A-                         NG                    NG                         B                   NG                  NG                     A-                              B
                                                                                    Evaluate the effectiveness of the
                                                                         8        implemented services, and modify as          Value                             0   2.30                0                      0                         0    3.00           0                     0                      0    3.70                 0       3.00                            4         3.85 3.56 3.56
                                                                                                needed.
                                                                                                                               Weight NG                             1.00                       NG                    NG                       0.50                  NG                  NG                     1.00

                                                                                                                               Grade    NG                           NG                         NG                    NG                       NG                    NG                  A+                        B                           B+
                                                                                Promote the profession of dental hygiene
                                                                         9         through service and affiliations with       Value                             0                       0                      0                         0                   0                     0    3.70              0    3.00                 0       3.47                            2           4         3.47 3.47
                                                                                       professional organizations.
                                                                                                                               Weight NG                             NG                         NG                    NG                       NG                    NG                  1.00                   0.50

                                                                                                                               Grade    NG                           NG                            A                  NG                       NG                    NG                  NG                        B                           B+

                                                                         10     Provide community oral health services.        Value                             0                       0    4.00              0                         0                   0                     0                      0    3.00                 0       3.33                            3           4         3.33 3.33

                                                                                                                               Weight NG                             NG                       0.50                    NG                       NG                    NG                  NG                     1.00
                                                                                                                               Blank and shaded = Does not measure this published outcome.
                                                                                                                               Weights: 0.5 = Measure gives anecdotal or indirect indication of published outcome, or has a limited sample size.
                                                                                                                                            1 = Measure provides direct, reliable information on the published outcome.



Submitted Month/Day/Year                                                                                                                                      32106e5c-8bfc-48bc-a032-6c759d801da8.xlsx                                                                                                                                                                                                                    Outc Results
Program Outcomes Assessment Discussion
      Program    Dental Hygiene
   Department    Division of Allied Health
College/School   Community and Technical College
Academic Year    2010
  Assessment
   Coordinator   Sandra Pence
                                                                                                      TABLE 3
                                                                                 ANALYSIS OF OUTCOME ASSESSMENT RESULTS
                 Note: Alternatively, an electronic word-processing document compatible with MS Word may be substituted for this table.
                                 Outcome                    Result                                                               Explanation of the Results



                  Provide dental hygiene care in a legal
            1                                               B+    Students continue excellent performance in providing legal and ethical care.
                          and ethical manner.

                 Exhibit professional behavior, including
                                                                  The attitude of a few students and general class behavior were not satisfactory. In appropriate computer use during class was especially alarming.
            2     time management, risk management,         B
                                                                  Recommend amending/clarifying program policy on computer/cell phone use in program handbook and development of a professionalism policy.
                 and respect of patients and co-workers.

                    Acquire, synthesize, and critically
                                                                  In general literature reviews were poorly written and articles were not thoroughly read. Students were lazy and demonstrated poor performance in
            3     analyze information in a scientific and   C+
                                                                  synthesis.
                            effective manner.

                 Collect, analyze, and record data on the
                                                                  Some students were lazy in treatment planning, e.g. put everyone in 6 mo recall as patient preference rather that optimal recall interval based on patient
            4        general and oral health status of      B+
                                                                  assessment.
                                 patients.
               Use critical decision making skills to
                develop a dental hygiene diagnosis,
                   which will provide a basis for
              interventions that are within the scope
            5                                               C+    Students were adequate in developing a dental hygiene diagnosis.
                  of dental hygiene practice and
                 determine the need for referral to
                 appropriate health professions as
                              needed.
                Formulate an oral health care plan,
                  including a planned sequence of
              educational, preventive, and therapeutic            Students need to remember they should consider the whole oral health of the patient, and not just the dental hygiene aspect. Oral/systemic connections
            6                                               C+
               services based on the dental hygiene               must be considered, as well as other oral conditions.
                 diagnosis in collaboration with the
              patient and other health care providers.
              Deliver preventive and therapeutic care
                to achieve and maintain oral health
            7 utilizing established infection control       A-    Both cohorts are performing at level in delivering care.
              procedures, pain control measures, and
                        ergonomic practices.
                    Evaluate the effectiveness of the
            8     implemented services, and modify as       B     Both cohorts are performing at level in evaluating effectiveness of care.
                                needed.
                 Promote the profession of dental
                                                                  All students are members of the American Dental Hygiene Association. The Class of 09 had an 82% conversion rate from student to professional
            9 hygiene through service and affiliations      B+
                                                                  member in ADHA.
                 with professional organizations.
                                                                  Community projects were adequate in providing service to the community. Students generally completed the minimal work expected on community
           10 Provide community oral health services.       B+
                                                                  projects, not going beyond what was absolutely required.




     Submitted Month/Day/Year                                                          32106e5c-8bfc-48bc-a032-6c759d801da8.xlsx                                                                          Outc Analysis
Program Improvement Recommendations Based on Assessment
      Program      Dental Hygiene
   Department      Division of Allied Health
College/School     Community and Technical College
Academic Year      2010
   Assessment
   Coordinator     Sandra Pence


                                                                        TABLE 4
                                      PROGRAM IMPROVEMENT RECOMMENDATIONS BASED ON ASSESSMENT RESULTS: CURRENT YEAR
                                  Recommendation                    Outcome(s)       Rationale for the Recommendation                                                Resource Implications

Change Assessment Competency form used in clinical courses to focus more on treatment                       The current form focuses too much on the details of
                                                                                                  6         data collection and less on the big picture of what                              0
                                   planning.
                                                                                                            the data means.


Change wording from "Formulate a a dental hygiene care plan" to "Formulate an oral health                   This wording emphasizes the oral/systemic
                                                                                                  6         connection and necessitates consideration of all oral                            0
                                     care plan"
                                                                                                            conditions when formulating a treatment plan.

 Increase scaling competency requirement in clinical courses, especially first year clinic.                 We lost one student this year after the third semester
                                                                                                            in the program because student could not remove
Have students mark any remaining calculus deposits on CPR after each scale check so that          7                                                                                          0
                                                                                                            deposits. Clinical mock Board performance was
                       individual weakness trends can be found.
                                                                                                            weak.

                                                                                                            Students are texting, e-mailing, and net-surfing in
         Amend/revise program policy regarding electronic devices in classroom.                   2         class. This is disrespectful and unprofessional                                  0
                                                                                                            behavior.

                                                                                                            This will emphasize expectations of respectful and
                                                                                                            professional behavior throughout the program. The
Create a program professionalism policy and have students sign the statement upon entry to                  selection committee added a question about
                                                                                                  2                                                                                          0
                                      the program.                                                          professionalism to the selection interview, and
                                                                                                            recommended having a professionalism policy in
                                                                                                            place.

            These recommendations should be relevant to the program itself.




                                                                         TABLE 5
                                ASSESSMENT PROCESS IMPROVEMENT RECOMMENDATIONS BASED ON ASSESSMENT RESULTS: CURRENT YEAR
                                 Recommendation                      Outcome(s)      Rationale for the Recommendation    Resource Implications


                   Add measure to an outcome with only one measure.                               2         Strengthens result.                                                              0




                                                                                                            Provides reviewers with quality details of
                Identify assessments that are formative and/or summative.                      1-3, 5, 6                                                                                     0
                                                                                                            measurements.


                                                                                                            This was a weak measure--mostly revealed
                          Deleted record-keeping as a measure                                    6,7        student's ability to document assessment and                                     0
                                                                                                            treatment, not actual diagnostic abilities.
                                                                                                            A revised community dental health course, along
                                                                                                            with instructor input regarding value of projects as
             Added community projects as a measure for multiple outcomes                       6,7,8,9                                                                                       0
                                                                                                            measures for these outcomes, resulted in increase
                                                                                                            use of this measure.

Added case presentations, competencies, and professionalism grade as measures for other                     These existing measures can be maximized by using
                                                                                              3,4,5,7, 10   them to measure other outcomes. Using more                                       0
                                      outcomes
                                                                                                            measures allows for a broader assessment as well.

                                                                                                            Currently we only have one measure of this outcome
             Consider using patient surveys to assess student professionalism.                    2                                                                                          0
                                                                                                            and another would add strength to the grade.
                                                                                                            A sample test was not included before to prevent
                                                                                                            student access because this is a public document.
                                 Add sample test to plan                                        1, 4-6                                                                                       0
                                                                                                            This year sample questions from several tests were
                                                                                                            included to satisfy this request.




      Submitted Month/Day/Year                                                                              32106e5c-8bfc-48bc-a032-6c759d801da8.xlsx                                            Current Yr Recommendations
Program Improvement Recommendations Based on Assessment
      Program     Dental Hygiene
   Department     Division of Allied Health
College/School    Community and Technical College
Academic Year     2010
  Assessment
   Coordinator    Sandra Pence


                                                             TABLE 6
                          PROGRAM IMPROVEMENT RECOMMENDATIONS BASED ON ASSESSMENT RESULTS: PREVIOUS YEARS
                                                                                                                              Rationale for the           Resource
     Year                                           Recommendation                                            Outcome(s)                                                                    Actions Taken
                                                                                                                              Recommendation             Implications
                                                                                                                           To aid faculty in
            2008 Develop professionalism grading rubric                                                           1,2      objectively assessing                        0 Rubric developed
                                                                                                                           student behavior

                                                                                                                           To strengthen treatment                          Assessment competency is being revised to
            2008 Emphasize treatment planning in clinical practicum courses.                                      6                                                     0
                                                                                                                           planning skills                                  focus more on treatment planning.

                                                                                                                           To help students improve
                                                                                                                           charting skills on
            2008 Development of written charting procedures for computerized charting                             4                                                     0 None--still needs to be done
                                                                                                                           computer program in
                                                                                                                           clinic
                                                                                                                           To provide students an
                                                                                                                           opportunity to develop
                                                                                                                           clinical competencies, and
                 Continue to develop external clinical sites to ensure adequate patient selection and
                                                                                                                           exposure to advanced
                 experience for all students. Increase number of patient screenings so that students work                                                                   Pursuing Memorandum of Agreements with
                                                                                                                           technologists available in
            2007 with appropriate level of difficulty. Include oral health assessment guidelines in seminar       1,2                                                       various off-site dental clinics and dental
                                                                                                                           private practices. State of
                 to improve patient management skills. Review patient selection guidelines, peer                                                                            offices within the community.
                                                                                                                           the art technologies which
                 mentoring.Improve Mock WREB exam w/ possible evaluation by offsite examiners
                                                                                                                           are not available are
                                                                                                                           available in private dental
                                                                                                                           clinics and offices.


                                                                                     TABLE 7




                 ASSESSMENT PROCESS IMPROVEMENT RECOMMENDATIONS BASED ON ASSESSMENT RESULTS: PREVIOUS YEARS




                                                                                                                              Rationale for the           Resource
     Year         Recommendation                                                                              Outcome(s)                                                                    Actions Taken
                                                                                                                              Recommendation             Implications

                                                                                                                                                                            This comment does not apply to our program--was
                (Please note: Not applicable to our program--see explaination under actions taken)                                                                          mistakenly included in our Peer Review
                Again, the faculty has responded to prior Peer Review recommendations to go from six                                                                        Comments and Recommendations. According to
                measures to two, which compress the multiple skills being assessed. Numerical grade                                                                         the assessment website's posting of program
                listed but not letter grade in measure box. Analysis page describes process of gathering                                                                    assessment plans and reports, the dental assisting
2009--from peer
                scores, but does not analyze why the scores, what they reveal, how to explain the scores.        N/A                  N/A                    N/A            program has recently changed from six measures
   committee
                No recommendations because students have been successful: this shows little reflection                                                                      to two. More than likely this comment was
                or dialogue by faculty on an assessment process that has been significantly revised over                                                                    intended for that program's plan. A request was
                the last few years. The faculty may indeed be doing such, but it does not show up on the                                                                    made to the Associate Vice Provost to remove this
                report.                                                                                                                                                     comment from the Dental Hygiene Peer Review
                                                                                                                                                                            Comments and Recommendations.


                                                                                                                                                                            Change in 2008 plan was in response to both peer
                                                                                                                                                                            review recommendations and a desire to have plan
                                                                                                                                                                            congruent with ADA-appoved program
                                                                                                                                                                            competencies. By making plan congruent with
                                                                                                                                                                            competencies (changing program outcomes to
                                                                                                                                                                            match program competencies) both were met. The
                Outcomes are good, but a large number to track; could some be combined and/or                                                                               ADA looks for specific criteria to be met; the
2009--from peer synthesized (like two and three, one & 2?) Was this plan a result of the ADA site visit,                                                                    progam prefers to have more outcomes to make
                                                                                                                General                                       0
committee       more than response to UAA "peer" review? Good examples of measure, except can you                                                                           accreditation compliance obvious. For this reason,
                come up with a representative sample of the written exam?                                                                                                   the number of outcomes is reasonable for this
                                                                                                                                                                            program. A written exam is not provided because
                                                                                                                                                                            the Assessment Plan is publically available and
                                                                                                                                                                            exams are confidential. I.e. if an exam were
                                                                                                                                                                            provided, students would have access. Exams can
                                                                                                                                                                            be provided on a confidential basis if the peer
                                                                                                                                                                            committee requests this.


                                                                                                                                                                            Descriptions for six of the eight measures were
                                                                                                                                                                            clarified. The term "Completeness" is used in a
                                                                                                                                                                            grading rubric developed for the case presentation
2009--from peer Peer review committee asks that some more description be provided for several of the
                                                                                                                General                                       0             for use by teachers. It was not developed for the
committee       measures, For example, 'completeness'--what does that mean?
                                                                                                                                                                            Assessment Plan. For 'completeness' the teachers
                                                                                                                                                                            look for thoroughness in content. This has been
                                                                                                                                                                            added to the rubric for peer review understanding.




      Submitted Month/Day/Year                                                            32106e5c-8bfc-48bc-a032-6c759d801da8.xlsx                                                   Previous Yr Recommendations
                                                                                                                    Due to the revision of the
                                                                                                                    assessment plan and change
2009--faculty                                                                                                       in assessment coordinators,         This measure was removed based on faculty
                  Contact graduates and allow more time for survey.                                        9, 10                                    0
initiated                                                                                                           the survey was conducted            recommendation.
                                                                                                                    late and did not allow
                                                                                                                    sufficient time for response.

                  Revise assessment plan to be congruent with program competencies developed for ADA
2008                                                                                                        all                                     0   New plan developed
                  accreditation
2008--from peer
                The plan should be updated to the new template.                                             all                                     0   The plan has been updated to new template
committee
                Seven outcomes are listed. National exams should be used as a measure, not an                                                           The outcomes were changed to reflect the required
2008--from peer outcome. The second outcome should be revised and combined with the first to provde                                                     competencies of the program as required for ADA
                more detail and definition of the skills and concepts necessary to pass the exam and be     all                                     0
committee                                                                                                                                               accreditation. These are more appropriate, as they
                employable. The third outcome should state what professionalism consists of to make it                                                  detail and define skills and concepts required.
                more measurable.
                Verbs on outcomes should be changed to reflect more than just 'demonstrating' the
2008--from peer                                                                                                                                         Our existing competencies use more appropriate
                outcomes, such as analyze, deduce, determine, differentiate, evaluate, formulate,           all                                     0
committee                                                                                                                                               verbs and replaced the previous outcomes.
                achieve, etc..

                Five measures are listed. The program could benefit from more direct measures taken
2008--from peer                                                                                                                                         Measures were updated to reflect current
                from exisiting coursework, such as class projects, presentations, or skills tests.          all                                     0
committee                                                                                                                                               measures for competencies.
                Discourage use of surveys.

2008--from peer
                The report should be updated to new template.                                               all                                     0   The report has been updated to the new template.
committee

2008--from peer A review of the report indicates students are doing very well on their exams, but does                                                  The number of samples or respondents has been
                                                                                                                                                    0
committee       not indicate the number of responses or samples in each measure.                                                                        included.




       Submitted Month/Day/Year                                                          32106e5c-8bfc-48bc-a032-6c759d801da8.xlsx                               Previous Yr Recommendations
                           Values by Tool                Year Average
                            Grade Table                   Grade Table
                            0         F                   A         4
                           0.3        F+                 A-        3.7
                           0.7        D-                  B         3
                            1         D                  B-        2.7
                           1.3        D+                 B+        3.3
                           1.7        C-                  C         2
                            2         C                  C-        1.7
                           2.3        C+                 C+        2.3
                           2.7        B-                  D         1
                            3         B                  D-        0.7
                           3.3        B+                 D+        1.3
                           3.7        A-                  F         0
                            4         A                  F+        0.3
                           NG                            NG




Submitted Month/Day/Year    32106e5c-8bfc-48bc-a032-6c759d801da8.xlsx    Grade Table

				
DOCUMENT INFO
Shared By:
Categories:
Tags:
Stats:
views:9
posted:11/5/2011
language:English
pages:7