Academic Department Assessment Program by 4u0Ehlo

VIEWS: 0 PAGES: 20

									                                   Pittsburg State University
              Academic Department Assessment Program
                                               2009 Annual Report


Note:     In Spring 2009, programs in the Department of Technology Studies and the Department of
          Technology Management were reorganized into the Department of Technology and
          Workforce Learning. This included Technology Management. Based upon the critique of the
          2008 Annual Report of Technology Management’s assessment program, the decision was
          made to streamline its assessment program in terms of assessment techniques, and
          reconfigure it to include direct measures of student learning; and report only assessment
          activities that resulted in curricular change. This 2009 report is in part an assessment
          planning document, since not all changes will be fully implemented nor all data collected.
          The Technology Management faculty members are meeting weekly to develop direct
          measures of student learning and formula an overall assessment plan. Descriptions of these
          plans will be included and be fully implemented during 2009-2010 academic year.
          Instrument descriptions and survey data that have been collected this year are included in
          this report.




Date:                May 6, 2009
Department:          Technology and Workforce Learning
Program:             Technology Management (BST)
                     Options: Option I – Specialized; Option II – Program Completion

     1.        Mission Statement for Technology Management:
               The mission of Pittsburg State University’s Technology Management program
               is to provide individuals with the knowledge and skills necessary to improve
               their leadership and management capacity, increasing their opportunities for
               employment and advancement.



     2.        Curricular Goals and Objectives:

             The goals of the Technology Management program are to produce graduates
          who:
               Goal 1. Have demonstrated knowledge and skills required for employment
               and advancement as a work supervisor or work team leader in the
               manufacturing or technology-based workplace setting.




Format adapted from the work of Gloria Rogers at Rose-Hulman Institute of Technology          TST - 1
               Objective 1.1: Students will demonstrate knowledge of leadership skills,
                              including team management, quality control, facility
                              management and maintenance, performance management,
                              and communication, by successful completion of paper-pencil
                              examinations, and real-world applications documented in a
                              Technology Management Portfolio.

               Objective 1.2: Students will demonstrate understanding of safety knowledge
                              and skills for the workplace setting, by successfully
                              completing a series of projects and real world applications
                              documented in the Technology Management Portfolio.

               Objective 1.3: Students will demonstrate competence in thinking skills–
                              thinking creatively, decision making, problem solving,
                              troubleshooting and diagnosing, and reasoning by
                              successfully completing a series of projects and real world
                              applications through field experiences and internships.

               Objective 1.4: Students will demonstrate knowledge of the management
                              professional, elements of professionalism, assessment
                              practices, and the role of these in career development, by
                              successful completion of paper-pencil examinations,
                              experiential projects and real-world applications (e.g.,
                              internships) documented in a portfolio.

               Objective 1.5: Students will demonstrate knowledge and skills in the use of
                              educational and instructional technologies associated with
                              technology management programs, as assessed by internship
                              evaluation forms and documented in a portfolio.

               Objective 1.6: Students will demonstrate the knowledge and skills gained in
                              Technology Management through internships and/or
                              cooperative programs with public and private organizations,
                              as assessed by internship evaluation forms and documented in
                              a portfolio.

               Objective 1.7: Students will demonstrate knowledge of the management
                              professional, elements of professionalism, assessment
                              practices, and the role of these in career development, by
                              successful completion of paper-pencil examinations,
                              experiential projects and real-world applications (e.g.,
                              internships) documented in a portfolio.


               Goal 2. Have engaged in a continuous process of assessment of advisement,
               instruction in the program, and student outcomes with the purpose of
               improving student learning in Technology Management.


Format adapted from the work of Gloria Rogers at Rose-Hulman Institute of Technology       TST - 2
               Objective 2.1: Students will assess quality of advisement using the on-line
                              advisement survey, the advisement segment of the
                              “Technology Management Program Survey,” and through the
                              exit interview process.

               Objective 2.2: Students will access the overall quality of a specific course
                              and instruction using the “ESPTE” or “SPTE” instrument,
                              and completion of the “Technology Management Program
                              Survey”.

               Goal 3. Have participated in a Technology Management program that
               reflect current trends and content found in business and industry, including
               human resource development activities and management practices.

               Objective 3.1: Learn managerial and supervision skills that reflects current
                              trends and practices, based on recommendations by the
                              Technology Management Advisory Committee.




     3.        Assessment Techniques (attach all instruments if appropriate)


                Goals                       Assessment Techniques
                            TM            TM             TM              SPTE or       TM Advisory
                          Portfolio   Internship     Advisement &      PSU-ESPTE         Council
                           (with      Evaluation     TM Program          (Student
                          Portfolio     Survey         Survey of      Perceptions of
                          Rubric)     (including       Students         Teaching)
                                       employer
                                       surveys)
                Goal         X            X
                 1
                Goal                                      X                X
                 2
                Goal                                                                       X
                 3




Format adapted from the work of Gloria Rogers at Rose-Hulman Institute of Technology                 TST - 3
4.       Assessment Results by Technique
         a. Technology Management (TM) Portfolio (with Portfolio Rubric)

          Description:
               The Technology Management Portfolio provides documentation of students’
               hands-on laboratory work, work on special projects, and field experiences
               throughout their career in the Technology Management program. The
               typical Technology Management Portfolio consists of the following major
               content areas:

                                     Resume
                                     A sample of school assignments and project work
                                     A job description of work duties
                                     At least three letters of recommendation
                                     Samples of product work, inventions, creations
                                     Samples of writing skills, including written reports, technical
                                      writing, etc
                                     A CD or video of the student and their work
                                     A completed job application

                  See Appendix A for detailed description of the Technology Management
                  Portfolio and the TM Portfolio Rubric used to score it.


          Results (2008-2009):
                  The Technology Management Portfolios have been used for several years.
                  The following is a summary of the scores.
             No. of         No.          Pass       Average         No. of      No. of     No. of   No. of   No. of
             Students       Passing      Rate       Rubric          Scores      Scores     Scores   Scores   Scores
                                                    Score           90-100%     80-89%     70-79%   60-69%   < 59

Spring            4             4        100%           87%             1              3      0        0        0
2009
Spring
2010


                  The portfolio identified the following areas of strength:
                      Project work
                      Samples of productivity
                      Writing samples

                  The content areas deemed “Need Improvement” were:
                      Resume
                      Letters of Recommendation
                  This will be addressed within the content of the courses.


Format adapted from the work of Gloria Rogers at Rose-Hulman Institute of Technology                          TST - 4
4.     Job application Assessment Results by Technique (continued)

       b. Technology Management Internship Evaluation Survey (including employer
         surveys)

            Description:
                 The Technology Management (TM) Internship Evaluation Survey is used to
                 assess the TM students internship experience during the Summer. The
                 typical TM Internship Evaluation Survey consists of the following major
                 content areas:
                      Management skills that need additional development
                      Leadership skills that the student has shown proficiency
                      Comments and suggestions for improving the intern experience

                  See Appendix B. for a copy of the Technology Management (TM) Internship
                  Evaluation Survey form, the Intern Employer Survey, and the TM Internship
                  Evaluation Rubric used to score the internship experience.


            Results (2008-2009):
                  The Technology Management Internship Experiences have been assessed
                  during the 2008-2009 academic year. The following is a summary table for
                  reporting their scores.
             No. of         No.          Pass       Average         No. of      No. of   No. of   No. of   No. of
             Students       Passing      Rate       Rubric          Scores      Scores   Scores   Scores   Scores
                                                    Score           90-100%     80-89%   70-79%   60-69%   < 59

Fall 2008    1              1            100%       95%             1           0        0        0        0
Summer       4
2009


                  The Internship Experience identified the following areas of strength:
                      Students showed good communication skills
                      Students showed good understanding of work measurement

                  The content areas deemed “Need Improvement” were:
                      Working with different types of people
                      Taking more initiative instead of waiting to be told what to do




Format adapted from the work of Gloria Rogers at Rose-Hulman Institute of Technology                           TST - 5
4.     Assessment Results by Technique (continued)

       c. Advisement and Technology Management Program Survey of
         Students/Graduates

          Description:
               The online PSU Advisement Survey is the instrument used to assess the
               student’s perception of the advisement process and their experience with
               their advisor. Students must go online and log into “Gus” in order to
               complete the survey. The online PSU Advisement Survey is one measure
               used in the assessment process. The perception of the advisement process
               and quality of the advisement are also included in the Technology
               Management Program Survey of Students/Graduates.

                  The Technology Management (TM) Program Survey will be used to
                  determine perceptions of the TM students overall experience in the program.
                  The Technology Management Program Survey of Students/Graduates
                  consists of the following major content areas:
                       Advisement
                       Coursework
                       Relevance
                       Job readiness

                  The Technology Management Program Survey of Students/Graduates form
                  will be developed Summer of 2009 and used during Spring 2010.

          Results (2008-2009):

                  The PSU Advisement Survey was administered in December 2008.The
                  following is a summary table of participation and perceptions of those
                  surveyed. See next page:




Format adapted from the work of Gloria Rogers at Rose-Hulman Institute of Technology       TST - 6
       TECHNOLOGY MANAGEMENT -– Faculty Member #1 (Main Advisor)


Student Advisement Survey Report
Statistics from 48 surveys in 08/WF
Personal Data

                                                  Strongly            No                           Strongly
  -                Questions                               Disagree                        Agree
                                                  Disagree          Opinion                         Agree
       I was able to meet with my           2.08%                                 6.25%    22.92% 66.67%
 Q1                               2.08% (1)
       advisor when I needed to.            (1)                                   (3)      (11)   (32)
    When I met with my
    advisor, the amount of time           0.00%                                   12.50%   29.17% 56.25%
 Q2                             2.08% (1)
    allowed for our meeting               (0)                                     (6)      (14)   (27)
    was ample.
    My advisor is
    knowledgeable about
                                                                  2.08%           6.25%    20.83% 68.75%
 Q3 university and                               2.08% (1)
                                                                  (1)             (3)      (10)   (33)
    departmental requirements
    for my degree program.
    My advisor is
    knowledgeable about the
                                           4.17%                                  6.25%    25.00% 62.50%
 Q4 requirements and             2.08% (1)
                                           (2)                                    (3)      (12)   (30)
    opportunities for careers in
    my area of study.
    I felt comfortable
                                                                  2.08%           8.33%    14.58% 72.92%
 Q5 discussing my academic                       2.08% (1)
                                                                  (1)             (4)      (7)    (35)
    needs with my advisor.




Based upon the survey data, no major deficiencies were noted. Overall student
satisfaction with advisement appears to be very good and consistent with level of
satisfaction with other departmental program majors.




Format adapted from the work of Gloria Rogers at Rose-Hulman Institute of Technology                   TST - 7
4.     Assessment Results by Technique (continued)

       d. PSU Technology Management SPTE (Student Perceptions of Teaching)

          Description:
               Each faculty member administers SPTE and or ESPTE instruments for each
               class taught. Students’ comments speak to satisfaction of course and
               instructor, but not overall program. Sample SPTE instrument and analysis
               are available for review in E222 KTC.



          Results (2008-2009):
                 For Fall ’08 and Spring ‘09, an analysis of SPTE mean scores for
             questions showed Technology Management to be consistently higher than the
             mean score of College of Technology and PSU. There were no specific
             deficiencies in courses or instruction noted. On the SPTE, instruction was
             rated “High” and “Very High” for most categories on TM courses

                     SPTE and ESPTE forms and data are available for review in E222 KTC.

                            Favorable SPTE and ESPTE feedback did not indicate any current
                             deficiencies.




Format adapted from the work of Gloria Rogers at Rose-Hulman Institute of Technology    TST - 8
4.     Assessment Results by Technique (continued)

       e. Technology Management Advisory Council

          Description:
               The Technology Management Advisory Council is a real strength to the
               program. The Advisory Council meets twice a year Input to the TM
               undergraduate program helps provide direction and guide curriculum
               development, etc.

                  Although the advisory council is not a direct measure of student learning, it
                  is a key to maintaining overall quality of the program. The council reviews
                  the curriculum—including activities, knowledge content, resources, etc.
                  Their review and recommendations are an integral component in providing
                  the students a quality program, where students learn what they need to learn
                  regarding TM.

                  Members of the Technology Management Advisory Council include:

                          Leo Sievert
                          Superior Industries

                          David Doherty
                          Carlisle

                          John Pettus
                          Kansas Department of Commerce

                          Mark Turnbull
                          City of Pittsburg

                          Chris Sterrett
                          Fort Scott Community College

          Results (2008-2009):
               TM Advisory Council Minutes are found in Appendix D.

                  The TM Advisory Council noted the following areas of strength:
                      Relevance to industry needs
                      Flexibility in scheduling and delivery

                  The TM Advisory Council noted the following areas as “Needing
                  Improvement”:
                      Development of a recruitment plan for four year majors
                      Development of scholarships for program students




Format adapted from the work of Gloria Rogers at Rose-Hulman Institute of Technology      TST - 9
5.     Curricular Changes Due to Assessment Results

       The following changes resulted in the Technology Management curriculum:

       a. Addition of TM 250 Introduction to Technology Management

          Description of Change:
               Addition of the course provides and opportunity for lower level undergrads
               an opportunity to find out what Technology Management is about. It also
               provides a foundation course for students choosing Technology
               Management as a major.



          Change was a result of the following assessment technique:

                  Advisory Council. The establishment of this course was based on
                  recommendations from the Technology Management Advisory Council.




Format adapted from the work of Gloria Rogers at Rose-Hulman Institute of Technology   TST - 10
               Appendix A. Technology Management Portfolio Content with Scoring Form


                                          Senior Portfolio Project
                                             Assessment Form

                                       Item                                            Points    Points
                                                                                       Earned   Possible
     Resume

     A job description of your work duties

     At least three letters of recommendation

     Samples of your product work, inventions, creations

     Samples of your writing skills, including written
     reports, technical writing, etc

     A CD or video of you and your work

     A sample job application filled out for my critique.


     Appearance

     Handed in Before Deadline (July 31)

     TOTAL


Comments:




Format adapted from the work of Gloria Rogers at Rose-Hulman Institute of Technology                TST - 11
             Appendix B. Technology Management Internship Evaluation Survey
                              (including Employer Survey)



           TM 683 Internship in Technology Management
Student: ____________________________________________ Semester:____________

Mentor: ____________________________________________ Department: __________

Institution: __________________________________________ Phone: ______________

As part of the degree requirements for the Bachelor’s of Science in Technology,
emphasis in Technology Management, the student is to spend one semester in an
approved mentored program. The student should spend 10 – 15 hours per week working
with the mentor in technology management activities outside their normal realm of
responsibilities.

Prerequisites: The student should be enrolled in TTED 683 Internship in Technology
Management.

Responsibility of the Mentor:

1. Provide the student with a variety of activities related to Technology Management.
   The intern should provide assistance to the mentor with responsibilities related to
   such issues as:
      a) Supervision of assigned projects
      b) Monitoring environmental health and safety in the workplace
      c) Measuring workplace efficiency
      d) Staff presentations/training
      e) Developing job descriptions
      f) Maintaining and managing facilities
      g) Etc.

2. Provide the student with an opportunity to observe other professional responsibilities
   and activities. This may include departmental or staff meetings, professional
   association meetings, team meetings, etc.

3. Complete a midterm report by July 1 and submit to:
     Dr. Mark L. Johnson
     Pittsburg State University
     Kansas Technology Center, Room S208
     Pittsburg, KS 66762




Format adapted from the work of Gloria Rogers at Rose-Hulman Institute of Technology   TST - 12
4. Submit an end of semester evaluation of the student and the internship experience by
   the last week of July.




Format adapted from the work of Gloria Rogers at Rose-Hulman Institute of Technology   TST - 13
Responsibility of the Student:

1. Attend/participate in mentor sessions regularly.

2. Serve as an assistant to the mentor. The intern should provide assistance to the mentor
   with responsibilities related to such issues as:
      h) Supervision of assigned projects
      i) Monitoring environmental health and safety in the workplace
      j) Measuring workplace efficiency
      k) Staff presentations/training
      l) Developing job descriptions
      m) Maintaining and managing facilities
      n) Etc.

3. Submit at midterm a summary of the internship activities completed plus major
   responsibilities for the remaining time in the semester by July 1 to:
       Dr. Mark L. Johnson
       Pittsburg State University
       Kansas Technology Center, Room S208
       Pittsburg, KS 66762

4. Participate in one or more of the following activities:
   a) Staff meeting
   b) Team meeting
   c) Professional Organization Meeting

5. Notify Dr. Mark L. Johnson, PSU Internship Coordinator of any problems that occur
   during the internship experience. The intern should attempt to first work out
   differences with the mentor. Open communications are essential.

6. Submit a final internship report of completed activities for the semester by the last
   week of July to:
      Dr. Mark L. Johnson
      Pittsburg State University
      Kansas Technology Center, Room S208
      Pittsburg, KS 66762




Format adapted from the work of Gloria Rogers at Rose-Hulman Institute of Technology   TST - 14
                                       Midterm Internship Report
Student: _____________________                                                         Semester:_________

Course: _________________________________________________________________

Supervising Mentor: ______________________________________________________

The Student Intern Should Complete the Following

1.        Management Activities: Describe the activities which you have done up to this
          time. Be specific, such as “Supervised work crew.”




2.        Describe any problems/difficulties you have had up to this time?




3.        Describe the major responsibilities that you will be doing during the remainder of
          this semester.




The Supervising Mentor Should Complete the Following

1.        What management skills have you found in which the student needs additional
          practice?




2.        What skills has the student developed or shown a professional level of
          competence?




3.        What Suggestions do you have that will help the intern during the remainder of
          the semester?




Format adapted from the work of Gloria Rogers at Rose-Hulman Institute of Technology                TST - 15
                                           Final Internship Report
Student: _____________________                                                         Semester:_________

Course: _________________________________________________________________

Supervising Mentor: ______________________________________________________

1.        Management activities: Summarize the management activities which you assisted
          with on the job. Be specific, such as “Supervised work crew.”




2.        HR Experience: List those skills or function, which you arranged for employees.




3.        Describe any problems that you may have had during the internship. (Your
          answers will be kept confidential.)



4.        What were your best three experiences during this internship? Be specific,
          explaining why you enjoyed each.




5.        What activities did you participate in? (i.e. crew meetings, training sessions, etc.)




6.        Evaluation: What suggestions do you have to improve this internship for future
          students?




Format adapted from the work of Gloria Rogers at Rose-Hulman Institute of Technology                TST - 16
            Appendix C. PSU Advisement Survey (Technology Management)and
             Technology Management Program Survey of Students/Graduates


Program survey to be added following its development.




Format adapted from the work of Gloria Rogers at Rose-Hulman Institute of Technology   TST - 17
     Appendix D. PSU Technology Management Advisory Council Agendas/Minutes

                                          Pittsburg State University
                                          Technology Management
                                                  Advisory Council
                                                  Tentative Agenda
                                                1:30 a.m. – 3:30 p.m.
                                                 December 11, 2008

         Welcome
         Program update and review
         Review of program content
          -Does it match industry needs?
          -What changes need to be made?
          -Council recommendations
         Paola TM Degree Fall 09
         Identification of Additional Council Members
         Selection of Advisory Council Chair
         Set next meeting time
         Adjournments




Format adapted from the work of Gloria Rogers at Rose-Hulman Institute of Technology   TST - 18
                                        Pittsburg State University
                                         Technology Management
                                                 Advisory Council
                                                       Agenda
                                               10:30 a.m. – 3:00 p.m.
                                              Tuesday, April 28, 2009

10:30 Welcome                  Mr. Nathan Young, HRD Advisory Council President
                               Dr. John Iley, TLW Department Chair
          Introductions
10:45 Strategic Plan, Department of Technology and Workforce Learning, Dr. Iley
11:00 Reorganization – College of Technology – Dr. Bruce Dallman
          Dr. John Iley, TLW Department Chair
11:25 Prestige Video Production Project, Dr. Mark Johnson
11:35 HRD Club -                Ms. Vidhi Kundalia, President
11:45 Lunch
12:45 Individual Advisory Council Meeting
      Technology Management – S224 (Rotunda; south of elevator)

          • Approval of Consent Agenda
          • Review of last meeting’s minutes
          • Update on program
                 Curriculum Changes – Dr. Mark Johnson
                 Dr. Johnson’s Visit to Taiwan
                 Paola Update

1:20• Program discussions
      a) Curriculum
      b) Internship Possibilities
      c) Recruitment
      d) Scholarships
      e) Set next meeting date

3:00      Adjournment


Council Meeting Site*
Technology Management Conference Room E227
Kansas Technology Center Pittsburg State University
Ford & Rouse Streets

*Park in visitors parking in south parking lot near the three flags


Format adapted from the work of Gloria Rogers at Rose-Hulman Institute of Technology   TST - 19
        The meeting of the PSU Technology Management Advisory Council was called
to order by TM Academic Advisor, Dr. Mark Johnson. Members present were: Mark
Turnbull, City of Pittsburg, Jon Pettus, Workforce Development, David Doherty, Carlisle
Products, and Chris Sterrett, Fort Scott Community College. The group accepted the
minutes as presented.

        Dr. Johnson provided the council with a TM program update and review. As of
the Fall 2008 semester, there were 25 students enrolled with a TM major. All were on
campus students. Dr. Johnson also reviewed program guides and program listings in the
PSU catalog. The council discussed program content related to matching industry needs,
possible changes that should be made and possible council recommendations. It was a
consensus of the group that for the most part, the program content was matched industry
needs. The group again suggested that increased opportunities for student internships be
explored. The group also suggested the development of an introductory level course for
the degree, as well as a course was needed in entrepreneurship for looking at the future.

        Dr. Johnson then discussed his recent visit with universities in Taiwan. There was
a discussion about the possibility of promoting the Technology Management 2+
Completion Program to universities in Taiwan.

       The group then discussed the Technology Management degree which will be
offered in Paola beginning Fall 09. It will be offered through Fort Scott Community
College’s Outreach Center. Classes will be offered in combination of in class, online, and
IDL formats.

       The council was asked to consider others that should be invited to join the group.
Names that were suggested included Janet McRae, Economic Director of Miami County
in Paola, and Buddy Jo Tanick, the Associate Dean at the Paola Center.

          The next meeting will be in November, 2009.

          The meeting was adjourned at 2:45pm.


Mark L. Johnson
Technology Management




Format adapted from the work of Gloria Rogers at Rose-Hulman Institute of Technology   TST - 20

								
To top