Use of Mastery Software in the Undergraduate OM Course by hY7s1p0X

VIEWS: 1 PAGES: 17

									Use of Mastery Software in
the Undergraduate OM Course

Peter J. Billington
Colorado State University – Pueblo



                                     1
Undergraduate OM Course
  Junior Level
  Required of all Business students
  Blend of quantitative and qualitative
  Tools and techniques, e.g.
     Project management, waiting lines
     MRP, inventory, SPC, learning curves
  Statistics as a pre-requisite

                                             2
Mastery Software
  Quant Systems’ Adventures in
  Operations Management
  Modules for a number of topics
  Demo mode – shows how it works
  Practice mode – student can practice
  Certify mode


                                         3
Certify Mode
   Student has ~ 10 problems with some
  subsections, varies each module
   Read question, calculate answer,
  submit answer.
   If correct, moves to next question.
   If incorrect, indicates a “strike” and
  gives correct answer
   Cannot correct the submitted answer

                                        4
Certify continued
   3 “strikes” and you’re out.
   Must start over.
   If answer all questions with fewer than
  3 strikes, student certifies.
   Gets a certification number and prints
  out certification sheet.
   Submits this to professor.

                                         5
AiOM in the OM course
   10 modules assigned in semester
   10% of course grade
   “All of nothing” - Must certify in all
  modules to receive the 10%, otherwise
  zero %
   Started with required submission
  before corresponding exam
   If student missed first, they gave up

                                        6
AiOM in the course - continued
   Changed to: submit any time before end of
  semester, but strongly urged to submit
  before exam.
   Some students certified before exam.
   Some did not.
   Positive student comments on course
  evaluation.
   Ah ha – “Maybe I should find out if they are
  affecting test scores!”

                                              7
Collecting Data
   After each exam, noted if student had
  completed corresponding AiOM.
   138 students
   636 exams
   Normalized each exam average to 100



                                       8
Results
   “Yes” means student did certify AiOM
  module before exam.
   “No” means student did not.
   Significance tests have not yet been
  performed on the data.




                                          9
Results
            No      Yes    Total
   % of
  exams    60.5%   39.5%   100%

 Average
  exam     96.9    105.0   100.0
  grade             +8.1




                                   10
Analysis
   Were the exam results and %
  completed before exam related to
     Grade in pre-requisite statistics course?
     GPA of student?
  Other factors?




                                                  11
Related to Stats Grade
 Grade in stats   Average Exam   % Exams
    course            Score        Yes
       A             112.1        52.6%
       B              97.8        32.7%
       C              97.2        32.4%
       D              92.5        20.0%
       F              94.2        27.8%

      All            100.0        39.5%    12
Related to GPA
 Student GPA   Average Exam   % Exams
                   Score        Yes
   3.5-4.0        113.8        70.8%
  3.0-3.49        105.1        36.7%
  2.5-2.99         97.5        41.0%
  2.0-2.49         90.7        19.1%

     All          100.0        39.5%
                                        13
Average Exam Grade
Grade in
  stats   No      Yes    Difference   Total
 course
    A    111.1   113.1     +2.0       112.1
   B     94.7    104.3     +9.6       97.8
   C     95.7    100.3     +4.6       97.2
  D      90.7    99.7      +9.0       92.5
   F     94.6    93.1       -1.5      94.2

  All    96.92   105.0     +8.1       100.0
                                             14
Average Exam Grade
 Student
   GPA      No      Yes    Difference   Total
 3.5-4.0   113.6   114.1      +0.5      113.8
3.0-3.49 103.3     108.1     +4.8       105.1
2.5-2.99   95.2    100.2     +5.0       97.5
2.0-2.49   88.9    97.9      +9.0       90.7

   All     96.92   105.0     +8.1       100.0
                                               15
Conclusions
   Certifying appears to improve grades.
   Makes little difference to top students.
   Makes a large difference for other
  students.
   GPA better predictor than stats grade.



                                          16
Next
   Add this semester’s 60 students and 300
  exams.
   Significance tests.
   Break out by difficulty of test material?
     Is difference in MRP test greater than for learning
      curve test?
   Other factors to consider?
   For a student that did not complete all on
  time, did it make a difference?
   End the experiment! Require for all!
                                                       17

								
To top