3430 Syllabus Spring 2010 by 90wJ25m


									                                        Course Syllabus
                                        Psychology 3430
                                    Principles of Assessment
                                          Spring 2010
                                   Tuesday, Thursday 2:30-3:50
                                             SC 130

"The mind is not a vessel to be filled, rather a flame to be kindled"
                                                       -Ancient Greek Philosopher

The mind, if stretched to consider new ideas, will never return to its original shape

“Not everything that can be counted counts, and not everything that counts can be
                                                    -Sign in Office of Albert Einstein

“You can’t fatten your cow by weighing it more often”
                                                   -Dr. Les Jones

Students with medical, psychological, learning, or other disabilities
desiring academic adjustments, accommodations, or auxiliary aids will
need to contact the Disability Support Center, Room 206F, Sharwan
Smith Center, phone (435) 865-8022. The Disability Support Center
determines eligibility for and authorizes the provision of these services
and aids.

Instructor/Office Hours:
Dr. Steve Barney
GC 308H      586-7955
Office hours Monday, Wednesday, Friday 8:30-10:00 a.m., Thursday 11:30-12:00 p.m. or
by appointment
e-mail- Barney@suu.edu

       McIntyre, S. A., & Miller, L. A., (2000). Foundations of Psychological Testing.
McGraw Hill; Boston, Massachusetts. (Used copies are available from various sources)

Lecture Information:
Lecture outlines are provided on the course web-site http://suu.edu/faculty/barney/PSY%203430.htm
 I recommend that you download and review each outline before class (you may want to print the
documents for note taking purposes). Documents needed for lecture are listed in the course schedule below
as bolded and italicized.
Course Outline and Goals
This course reviews the theory and application of assessment approaches used in psychology, education,
business, and other areas. Assessment involves the scientific method and usually relies heavily on
measurement (converting an experience to a quantitative value in order to facilitate statistical processes). A
comprehensive overview of this topic requires three components:

         First, we will cover testing theory and measurement, the need for testing, test construction and
                   development along with a review of the necessary statistical functions used in testing.
                   Emphasis will be placed on critical thinking, reliability and validity analysis and utility of
                   test instruments.

         Second, the application of these principles will be experienced firsthand as each student will
                  participate in an experimental group that will generate, plan, and conduct a project using
                  psychological tests, questionnaires, surveys, etc. Projects may include, but are not limited
                  to doing a validation study of an existing instrument, devising and testing a new
                  instrument, comparing several existing instruments, assessing an agency or program, etc.
                  Data from each project is to be coded, entered, and analyzed statistically with a
                  computerized statistical package (SPSS [Statistical Package for the Social Sciences] is
                  available on the SUU Student Server). An in-class presentation at the end of the semester
                  will, in part, determine your final grade. You will also rate your group-mates on their
                  contributions to the project as part of their final grade. Projects will be submitted for oral
                  or poster presentations at departmental, university, regional, or national conferences. Get
                  with me early if you are interested (Deadlines are early in Fall Semester for Spring or
                  Summer conferences). With enough work, some projects could easily be turned into
                  manuscripts to submit for publication.

         Finally, we will review, take, score and interpret several different types of tests used in
                  Psychology and counseling practice today. Discussion of specific testing issues will take
                  place throughout the course. Although the course is called Principles of Assessment and
                  is offered in the psychology department, comprehensive assessments are becoming more
                  popular in business, industry, education, and other related fields. The principles learned
                  in this course could be beneficial in many different occupational settings.

Coursework, Grading, and Evaluation
         There will be four examinations in the class. While they are not technically "cumulative" in
         nature, information learned in previous sections will be helpful in future ones. Don't think you can
         learn and forget after the test is over. Up to and maybe more than 5 quizzes will be given to assess
         whether you have been doing your reading assignments. If every one is doing OK there may be
         fewer quizzes, if not, there may be more. Each quiz is worth 10 points.

SPSS Assignments:
       Students will be required to complete 4 assignments using SPSS. The assignments will involve
       entering, organizing, and analyzing data with one of the most powerful and most common
       statistical packages used in the social sciences. Each assignment can be completed anywhere you
       can access your student account. An orientation to the program will take place. Each assignment
       is worth 10 points.

Research Project:
        Each student will employ the scientific method in a hands-on research project. This can be
accomplished in one of two ways.

Option #1: You may decide to accomplish this project as part of a research group or team (no less than
        two and no more than 4 members are allowed). Each team is responsible to produce a research
        project using test and measurement principles. Preferred projects are those that attempt to
        establish reliability or validity of existing instruments, design, administer, and evaluate a new
instrument, compare several different measures of a similar construct, or assess the quality of a
program or agency. This is an ambitious project and could require a lot of time and energy. You
are encouraged to spread the work throughout the group. The steps involved include:
              Coming up with an idea
              Becoming an expert in that idea by extensively reviewing available literature
              Identifying gaps or holes in the literature that your group can answer
              Formulating a project outline based on what you have read and learned
              Writing a proposal (2-5 pages or so)
              Submitting the proposal to me for approval, recommendations,
                 condolences, etc.

Once my approval for the project has been granted, you will need to submit a formal proposal for
review by the Institutional Review Board (IRB) for Research with Human Subjects. Such proposal
will include:

                  a brief description of the project including a short literature review
                   a methods section (how you plan to do what you want to do
                   a statistical analysis section (what statistical analyses will you run)
                   what is hoped to be gained by doing the project
                  any potential risk to participants
                  remediative plans to those participants that may be affected or harmed.

The full IRB policy and procedure can be found at the web site:
Or http://www.suu.edu/pub/policies section 6.20.

Each member of the class will also be required to complete a two-hour tutorial training on research
with human subjects. The URL is:


You need only complete this training one time after March 1, 2008. If you have already done it for
another class, turning in a copy of the completion certificate is sufficient. If you have not already
done the training, or if you completed the training prior to March 1, 2008, you must complete the
current version of the training. Please do so early in the semester and turn A COPY OF the
completion certificate in to me. This is worth 25 points.

For a project of this type, data collection from a specialized group of participants (substance
abusers, criminal offenders, individuals with eating disorders, youth, the elderly, etc.) would be the
most interesting-if the study has redeeming value to that group. If populations like these are not
available, Introductory Psychology instructors have volunteered their classes as victims...I mean
participants for us. You will need to decide on a project very early in the semester so you can gain
approval, do the appropriate research, run the correct statistical procedures, and plan your poster
and presentation.

Finally, I expect that all projects will be presented in a professional-like manner in class during
the last week of school (Approximately April 22) at the Annual Undergraduate Research and
Scholarship Day. Moreover, this type of project, if done well, has great potential of being
published or presented at a regional or national convention. These types of things look really good
on resumes and/or graduate school applications. However, producing this quality of work will take
extra time and effort. If there are some of you interested in this type of project, you may want to
get together as a team and do the work. You will need to let me know right away so I can be
exploring sources of publication or presentation.

You are expected to turn in a well-written APA Style research report. Please review all the rules
of APA Writing Style you learned in PSY 2010. Also, there are several resources available from
me, in the psychology office, or on the APA web-site (APA.org). The grading schemes for the
          presentation and for the paper are attached to this document. If you are in a group, you will also
          rate the relative contribution of each group member to the project.

          A good source for information on specific tests is Buro's Mental Measurements Yearbook (MMY)
          in the reference section of the library or at their website http://www.unl.edu/buros/
          Another good resource for testing information or professional issues is PSYCHOLOGICAL
          ASSESSMENT ONLINE http://wso.net/assessment
          I have the password for the professional resources section. If you are interested, come see me and
          I will give it to you....maybe. (praecox)
          Our library has the Mental Measurements Yearbook, and the Directory of unpublished
          experimental mental measures; both of which are valuable resources.

          Also, I have several copies of Psychological Assessment on file in the Psychology office. These
          journals contain published articles about assessment, testing, and measurement. You can find new
          instruments as well as ideas for how to structure your project. Finally, I have on file in the
          psychology office, a folder of sample reliability and validity projects taken from various
          professional journals.

          This project will be completed in one semester, and you will each evaluate the contribution of
          fellow team members. This is a lot of work, so getting started early is by far the best approach. I
          have several projects ready and I may have some ideas for others.

Option #2: You may decide to do a project independently. The academic rigor and expectations for you
        are the same as for the research groups. However, you would have the option of developing this
        project this semester and then actually conducting the research in the Summer as your Independent
        Research II (PSY 4925) project. For this class, it is expected that you develop your idea, do an
        extensive literature review, formalize your project, and obtain IRB Approval for the project.
        Grade for your project for this class will be based on these criteria.

          Grades in the class will be given according to university policy and using standard grade cutoff
          scores. Final grades in the course will be calculated from total points achieved from each of the
          following sources:

Training Certificate                                    25

Tests                                                   400
          4 @ 100 points each

Quizzes                                                 50
          5 @ 10 points each

SPSS Assignments                                        40

          4 @ 10 points each

Project Idea Assignment Due                             10 pts

IRB Initial Draft Due                                   25 pts

Project Lit Review Draft Due                            50 pts

Research Project Paper                                  100
        APA Style                    10 points
        IRB Proposal                 10 points
        Introduction                 20 points
        Methods                      20 points
         Analysis                   10 points
         Results                    15 points
         Conclusions                15 points

Research Presentation
        Presentation                100 points

TOTAL                                         800

Final Grades will be calculated as per standard schedule

         A        93-100%           C-        70-72%
         A-       90-92%            D+        67-69%
         B+       87-89%            D         63-66%
         B        83-86%            D-        60-62%
         B-       80-82%            F         00-59%
         C+       77-79%
         C        73-76%

Incompletes and/or Unofficial Withdrawals will be assessed as per university policy. Add-Drop and
Withdrawal dates will be announced in class, but it is your responsibility to know the deadlines and take
what action you feel is best for you. If you have questions or concerns, please stop by during office hours,
or whenever I am in my office and have some free time.

Class Schedule
Below is a tentative schedule (As the instructor, I reserve the right to make changes in the following as I
see fit. I will give as much notice as possible regarding any changes):

Tuesday, January 5           Introduction, syllabus, etc. Complete BSI Questionnaire. Chapter 1
Thursday January7            Principles of Assessment, Model of Psychology, Definitions Lecture -Begin
                             Definition of Terms (Norms, Standardization, Reliability, Validity) (Chapter 2)
Tuesday, January 12          Begin Definition of Terms (Norms, Standardization, Reliability, Validity)
                             (Chapter 2) Project Assignment Groups
Thursday, January 14         Constructing a Test, Test Plan, Composing Test Items (Chapter 10), Class
                             Survey Initiated
Tuesday, January 19          Constructing a Test, Test Plan, Composing Test Items (Chapter 12), Class
                             Survey, Class Survey Completed, Data Collection initiated.
Thursday, January21          Ethical Issues, The Scientific Method, Psychometrics, Statistical review, data
                             organization, scales of measurement, descriptives, MCT's (Chapter 3)
Tuesday, January26           Ethical Issues, The Scientific Method, Psychometrics, Statistical review, data
                             organization, scales of measurement, descriptives, MCT's (Chapter 5)
Thursday, January 28         Distributions and Standard Scores, Z Score Overheads; Standardized scores
                             (Chapter 5)
Tuesday, February 2          Distributions and Standard Scores, Z Score Overheads; Standardized
                             scores/statistical review (Chapter 5,) Exam #1 Take Home (Syllabus,
                             Lectures, Chapters 1, 2, 3, 5, 10, 12)
Thursday, February 4         SPSS orientation in the psychology computer lab. SPSS Assignment #1 (data
                             entry and descriptives) (Take Home Exam Due)
Tuesday, February 9          Correlation and Regression, Inferential Statistics) SPSS Assignment #1 Due
Thursday, February 11        Correlation and Regression, Inferential Statistics, SPSS Assignment #2
                             Correlation and Regression
Tuesday, February 16         Standard Error, Standard Error and Reliability (Chapter 6) SPSS
                             Assignment #2 Due
Thursday, February 18        Standard Error, Standard Error and Reliability (Chapter 6)
Tuesday, February 23         Test Validity (Chapter 8, & 9)
Thursday, February 25        Test Validity (Chapter 8, & 9) IRB Initial Draft Due

Tuesday, March 2             Exam #2 Psychometric Review, Reliability, Validity, (Lectures, Chapters 5,
                             6, 7, 8, &9)
Thursday, March 4            Constructing a Test, EASE-PI Development (Chapter 11)
Tuesday, March 9             Project Day
Thursday, March 11           Project Literature Review Draft Due (50 pts)
Tuesday, March 16            Spring Recess…No Class
Thursday March l8            Spring Recess…No Class
Tuesday, March 23            Review
Thursday , March 25          Review
Tuesday, March 29            Project Day
Thursday, April 1            Using Tests in Educational Settings (Chapter 13)
Tuesday, April 6             Using Tests in Educational Settings (Chapter 13)
Thursday, April 8            Using Tests in Clinical Settings (Chapter 14)
Tuesday, April 13            Using Tests in Clinical Settings (Chapter 14)
Thursday, April 15           Using Tests in Organizational Settings (Chapter 15)
Tuesday, April 20            Exam #3 (Chapters 11, 13, 14, 15)
Thursday April 22            Project Presentation Day Project Papers Due) (Take Home Final Exam
Thursday April 29 3:00-      Final Exam
4:50 p.m.

Course Evaluations: As of Fall Semester 2006, students will evaluate their face to face courses online,
using a program called WebCT. The previously used Scantron system, with the paper and pencil survey
will NO LONGER be used. During the last week of instruction, all students will have access to WebCT for
the purpose of evaluating each of their courses. To access this system, students will (1) on the Internet, go to
SUU’s Homepage (suu.edu); (2) click Current Student (3) click WebCT (4) log in with Username and
Password exactly as done in the campus computer labs—If students don’t know their Username or
Password, they can click on the choices on this screen that will provide them ; (5) once logged in, students
will see a list of courses, with Course Evaluation in each title –they will then click on the course they wish
to evaluate

There may be money available to help students with research expenses via grants offered through the
Undergraduate Research and Scholarship Program (UGRASP). Please see the UGRASP web-site
http://suu.edu/ugrasp/grants.html for information on application dates and grant criteria. Two types of
awards are offered, Small Grants of $100.00 or less, and awards between $100 and $500. Awards of less
than $100 are given any time they are requested, as long as the request meets the criteria and has a mentor
or faculty supervisor’s signature and the department chair’s signature. Students must request funds before
expenditures are made.

The larger grants are awarded in 2 rounds per semester. The deadline for applications for round 1 is the end
of the 3rd week in February. Round 2 deadline is the end of the 2nd week in November. These awards are
competitive and decisions will be made by the UGRASP committee.

If you receive any grant money from UGRASP, you are required to submit an expenditure report along with
receipts for reimbursement.

Students may want to visit the Speech and Presentation Center. Please contact Sage Platt. 586-5452 Help
is available to improve public speaking and overcoming speech anxiety.
PSY 3430 Class Objectives

By the end of this course you will have had the opportunity to do the following;

Understand the importance of and how to calculate each of the following;
Measures of Central Tendency
Measures of Dispersion
        Standard Deviation

Standardized Scores
        Sten Scores

Percentile Ranks
Area under the curve
Pearson Product Moment Correlation Coefficient
Generalized Least Squares Regression
Standard Error of the Measure
Confidence Intervals (95% and 99%)

Enter data into SPSS and perform various exploratory analyses (measures of central tendency, measures of
dispersion, bivariate correlation)
Understand and interpret bivariate correlation coefficients

Understand the scientific method
Explain the concepts of Hypothesis Testing (Ho, H1) along with Decision Errors (Type I, Type II)
Construct a measurement survey and conduct the following psychometric analyses;
         Measures of central tendency
         Measures of dispersion
         Reliability (Split Half with Spearman Brown Correction, Test-Retest, Internal Consistency)

Run and interpret a reliability analysis using SPSS 17 (Item-Total Correlation, Scale if Item Deleted)
Run and interpret an exploratory Factor Analysis using SPSS 17

Complete a Research Proposal for an Institutional Research Board for Research with Human Subjects (IRB)

Participate in a research team in designing, carrying out, and reporting on a research project involving measureme nt

Make a professional presentation of your research findings
                            Chapter 1 Model
                               PSY 3430
                            Dr. Steve Barney

Psychology- The scientific study of behavior and mental processes
     Goal of Psychology- Understanding

        Objectives of Psychology----------Methods of Psychology

          Describe Behavior -----------------Measurement
                                               Case Study
                                               Naturalistic Observation

           Predict Behavior-----------------Correlation
                                               Strength and Direction
                                               Illusory Correlates
                                               Not Causation

           Control Behavior----------------Experimentation
                                              IV and DV
                                              Experimental Group
                                              Control Group
                                              Random Assignment
                                              Operational Definition
                                              Hindsight Bias

     Perspectives in Psychology
          Behavioral Genetics
PSY 3430
                             Project Paper Grading Scheme

     IRB Propoal                               10 points   _________

     APA Style                                 10 points   _________

     Introduction                              20 points   _________
           Lit Review
           Funnel Approach

     Methods                                   20 points   _________

     Analysis                                  10 points   _________
           Described Adequately

     Results                                   15 points   _________
           Correctly written
           Contains all relevant information

     Conclusions                               15 points   _________
           Discussion of results
           Recommendations for further study

                                                     Total _____/100___
PSY 3430
                          Project Presentation Grading Criteria

Appearance                                    30 pts
      Professional Appearance        10 pts
      Organized                      10 pts
      Confident                      10 pts


Literature Review                            40 pts
        Funnel approach               10 pts
        Details                       10 pts
        Lead to a specific hypothesis 20 pts

                                              Total ______

Methods/Statistical Analyses                  10 pts
      Explanation of statistics chosen
      Understanding of statistics


Results and Conclusions                       20 pts
       Critique of work
       Responses to questions


To top