Documents
Resources
Learning Center
Upload
Plans & pricing Sign in
Sign Out

Statewide Measurement Tool Guidelines

VIEWS: 4 PAGES: 3

									                                                      Statewide Measurement Tool Guidelines
                                                                                     July 2011
                            Required for
  Statewide                 Programming
 Measurement               Directly Serving              Recommended Time between
     Tool    Age Range          Youth                          Pre- and Post-test                                                              Notes
Youth NOMs 12 - 18 years Block Grant          Change in 30-day use (items 8-14):                   1. Mean change from pre- to post-test (rather than % change) is the recommended
                         PDD                  -Ideal = 30+ days                                    measurement for the following:
                         LEAF                 -Minimum = 15 days                                   - Perceptions of risk of harm (items 15-17)
                                                                                                   - Attitudes toward ATOD use (items 18-22)
                                              Change in talking to parents (item 23), driving
                                              under the influence (item 25), and advertising       2. Percent change from pre- to post-test (rather than mean change) is the recommended
                                              (item 26):                                           measurement for the following:
                                              -Ideal = 365+ days                                   - 30-day use (items 8-14)
                                              -Minimum = 180 days                                  - Talking to parents (item 23)
                                                                                                   - Drug and alcohol testing (item 24)
                                              Note: There are no time restrictions for assessing   - Driving under the influence (item 25)
                                              change in the following:                             - Advertising (item 26)
                                              - Perceptions of risk of harm (items 15-17)
                                              - Attitudes toward ATOD use (items 18-22)            3. Change from pre- to post-test is most likely for the following:
                                                                                                   - Perceptions of risk of harm (items 15-17)
                                                                                                   - Attitudes toward ATOD use (18-22)

                                                                                                   4. Change from pre- to post-test is not likely on the following for participants who do not
                                                                                                   drive:
                                                                                                   - Driving under the influence (item 25)

                                                                                                   5. Change from pre- to post-test is not likely on the following for participants who are not
                                                                                                   old enough to work:
                                                                                                   - Drug and alcohol testing (item 24)

                                                                                                   6. Change from pre- to post-test in a given year is likely to be similar to change in a
                                                                                                   subsequent year if the program is serving new participants each year. A “bigger change” in
                                                                                                   Year 5 versus Year 3 is unlikely because different program participants are surveyed each
                                                                                                   year. If the program stays the same, it will have the same effect on Year 3 participants’ pre-
                                                                                                   to post-test change that it has on Year 5 participants’ change.
                                Required for
 Statewide                      Programming
Measurement                    Directly Serving              Recommended Time between
    Tool        Age Range           Youth                          Pre- and Post-test                                                          Notes
Safe Driving   14 - 18 years PDD                  Change in any item:                                1. Mean change from pre- to post-test (rather than % change) is the recommended
Measure                      LEAF                 -Ideal = 30+ days                                  measurement for all items.
(SDM)                                             -Minimum = 15 days
                                                                                                     2. Section A (driving behavior of self and others, items 3-14) applies only to youth who
                                                  Note : All items ask about the past 30 days.       have ever driven a motorized vehicle.

                                                                                                     3. Section B (riding behavior of self and others, items 15-26) applies to anyone who rides in
                                                                                                     motorized vehicle with others.

                                                                                                     4. Change from pre- to post-test is not likely for populations that score low on items at pre-
                                                                                                     test.

                                                                                                     EXAMPLE: If there is an average of less than 1 day of driving under the influence of alcohol
                                                                                                     at pre-test, the average number of days of driving under the influence at post-test is
                                                                                                     unlikely to be significantly lower.

                                                                                                     5. Change from pre- to post-test in a given year is likely to be similar to change in a
                                                                                                     subsequent year if the program is serving new participants each year. A “bigger change” in
                                                                                                     Year 5 versus Year 3 is unlikely because different program participants are surveyed each
                                                                                                     year. If the program stays the same, it will have the same effect on Year 3 participants’ pre-
                                                                                                     to post-test change that it has on Year 5 participants’ change.


Healthy Kids Middle         Not required          N/A                                                1. May be appropriate for assessing the impact of environmental strategies designed to
Colorado      School & High                                                                          impact ATOD attitudes, perceptions and behavior over time.
Survey (HKCS) School                              Note: HKCS does not assess change from pre- to
               students                           post-test because different individuals take the   2. It may take several years of implementing a strategy before change is observed in HKCS
                                                  survey each year.                                  data compared to baseline*

                                                                                                     *baseline = HKCS data collected prior to strategy implementation

                                                                                                     3. The potential impact of the strategy can only be assessed if the population of students
                                                                                                     surveyed is mostly the same as the population of students who were exposed to the
                                                                                                     strategy.

                                                                                                     EXAMPLE: HKCS is unlikely to detect potential impact of the strategy if only one school is
                                                                                                     exposed to the strategy but the HKCS report is for the entire school district.

                                                                                                     EXAMPLE: HKCS is unlikely to detect potential impact of the strategy if all youth in a multi-
                                                                                                     school community were exposed to the strategy but the HKCS report is only for one of the
                                                                                                     schools.

                                                                                                     EXAMPLE: HKCS is more likely to detect potential impact of the strategy if the strategy is
                                                                                                     implemented in one school and the HKCS report is for that school.
Example Question for Mean Change on Youth NOMS:                          Example Question for Percentage Change on Youth NOMS:

How much do you think people risk harming themselves (physically or in   23. Now think about the past 12 months, that is, the past year.
other ways) if they do the following…                                    During the past 12 months, have you talked with at least one of your
                                                                         parents about the dangers of tobacco, alcohol, or other drug use? (By
15. How do you feel about someone your age smoking one or more packs     parents, we mean either your adoptive, biological, stepparents, or
of cigarettes a day?                                                     adult guardians, whether or not they live with you.)

               1 = Approve Think it’s OK                                                YES           NO
               2 = Neither Approve nor Disapprove
               3 = Somewhat Disapprove
               4 = Strongly Disapprove
                                                                         The desired change from pre- to post-test is an
                                                                         increase in the percent of youth who answer 'Yes'. An
                                                                         increase in the percent of youth who responded 'Yes'
The desired change from pre- to post-test is a mean                      at post-test indicates an increase in youth talking to
increase. A mean increase indicates that on average,                     their parents about the dangers of ATOD use.
youth provided responses at post-test that were greater
on a 1-4 scale (i.e. more disapproving) than their
responses at pre-test.

								
To top