Northwest Evaluation Association
Teacher‟s Guide to Measures of
Academic Progress
MAP
Intended Accomplishments
Introductions
MAP Basics
Test Administration
Demo of TestTaker
Reports
Communicating with Parents
Other Resources
Looking Ahead
Optional Lab Practice
Partnering to help all kids learn Revised 6/26/2003 2
Handout — Agenda
Key to Pictures You’ll See
= discussion item, small or whole group
= key point, pay special attention to
this!
= refers to a tool for your use
= something for you to think about
Partnering to help all kids learn Revised 6/26/2003 3
What questions do you want
answered today?
What do you want to know
about MAP assessments
and the reports you will
receive?
How can this workshop
meet the needs of your
district?
Partnering to help all kids learn Revised 6/26/2003 4
NWEA Partner Districts
We partner with districts
nationwide to help all kids learn.
WA
MT ME
ND MN
OR
NH
ID WI NY
WY MI RI
CA IA PA
NV NE
IL OH
UT IN
CO VA
KS
KY
NC
AZ TN
AR
NM SC
AK GA
TX
Partnering to help all kids learn Revised 6/26/2003 5
Our Purpose
Our purpose is to help all kids
learn; more tomorrow than
today, more next year than this
year.
Our purpose is growth and
improvement of learning.
Partnering to help all kids learn Revised 6/26/2003 6
NWEA Mission
Partnering to
help
all kids learn
Partnering to help all kids learn Revised 6/26/2003 7
Quick Survey
How many of you
attended a MAP Intro
workshop?
How many of you have
received information
about NWEA assessments
and/or the MAP system?
Partnering to help all kids learn Revised 6/26/2003 8
Pre-Assessment
How is MAP different from conventional
assessments?
What does RIT stand for?
What are some of the features of the
RIT scale?
How does the MAP system know where
to give a student the first question?
How soon is data available after a
student takes a MAP test?
Partnering to help all kids learn Revised 6/26/2003 9
Assumptions of ‘Graded’
Schools
Curriculum scale
Skills taught may begin with
associating sounds with letters
Adult Reading
in K-1, to adult levels in high
school
Typically, we feel restricted to
“covering” specific curricula
5th
related to adopted grade level Grade
standards
Think about …
Does this design meet the Beginning Literacy
needs of all students?
Partnering to help all kids learn Revised 6/26/2003 10
How does classroom reality
relate to our assumptions?
We have students
performing above, at, and Adult Reading
below this „grade level‟
curriculum x
x
How does this impact
assessment and 5th x
x
x x x
x
instruction? Grade
x x x
x
The profound challenge: x
x
x
HOW DO WE FOSTER
GROWTH FOR ALL
Beginning Literacy
STUDENTS?
Partnering to help all kids learn Revised 6/26/2003 11
Instructional Level vs. Mastery
The NWEA test provides the
instructional level of the
student.
It provides a road map for
students toward achieving
mastery.
It is not a test for determining
mastery of skills.
Partnering to help all kids learn Revised 6/26/2003 12
Features of MAP Test
Challenging, appropriate and
dynamically developed for every
student
Accurate data for students across the
scale
Untimed
Purpose is internal accountability
Measures growth in student
achievement
Immediate results
Can test up to 4 times a year
Partnering to help all kids learn Revised 6/26/2003 13
Design & Features of MAP
Adult Reading MAP Test
Test
x -
x + - + - - + 215
x + ++
5th x xxxx +
Grade xxx x
xx
x
Beginning Literacy
Partnering to help all kids learn Revised 6/26/2003 14
RIT (Rasch Unit) Scale
Achievement
scale
Equal interval Adult Reading MAP Test
Used to show x
250
growth over time x
+
-
- - +-
+ + 215
Scale has the 5th x
x
x x x
x
+
+ +
same meaning Grade x x x
x
x
regardless of the x
students‟ grade x
level or items 150
Beginning Literacy
taken
Partnering to help all kids learn Revised 6/26/2003 15
Checkpoint
How is MAP different from
conventional assessments?
What does RIT stand for?
What are some of the features of the
RIT scale?
How does the MAP system know where
to give a student the first question?
How soon is data available after a
student takes a MAP test?
Partnering to help all kids learn Revised 6/26/2003 16
Uses of MAP
Intake testing
Parent conferences
Monitoring progress
across time
Course Placement
Monitoring students
in Special Programs
Partnering to help all kids learn Revised 6/26/2003 17
How do I know which test
to give?
GOALS Survey Survey
– 42-52 items – 20 items
– ~ 1 hour to – ~30 minutes to
administer administer
– Gives information – NO INFORMATION
on goal areas on goal areas
– Most commonly – OVERALL RIT only
used fall and – Most commonly
spring used for intake and
winter testing
Handbook— Page 3
Partnering to help all kids learn Revised 6/26/2003 Guidelines for Choosing the
Correct Test
18
Handout - Goal Structure
Role of MAP Coordinator
Key point of contact for
district questions and NWEA
staff
Receives all user names and
passwords to distribute
Receives all updates from
NWEA
Responsible for arranging
scheduling and coordinating
the entire process
Must make sure a new Class
Roster File is prepared and
sent to NWEA EACH season
Partnering to help all kids learn Revised 6/26/2003 19
Handbook— Pages 4-7
Roles and Responsibilities
Principals
Distributes user names and password to
teachers for accessing teacher level
reports
Assists with scheduling
Checks to see that all teachers are in
student data file
Makes sure teachers have copies of
reports
Schedules time to meet with grade level
teams on MAP data
Partnering to help all kids learn Revised 6/26/2003 20
Proctors Teachers
Ready all computers for Let students know computer
testing assignments
MAKE SURE CORRECT Show MAP Practice Test to
TESTS ARE ASSIGNED!!! students
Before
Number class lists to Have students bring book to
Testing computers, share with read or assignment
teachers Bring class to computer lab at
Have scratch paper and designated time – help find
pencils available computers
Read directions to students Remain in lab to help monitor
Monitor test event test event
During Invalidate tests as needed
Testing Log scores or print screen
at end of test
Prepare computer for next Access teacher reports 48
group to test between hours after data is uploaded
testing session Analyze class and teacher
After Upload data to NWEA at reports
end of every day during
Testing testing (this may be a tech
Discuss student scores with
parents and students
responsibility) Implement necessary
instructional modifications
One Week Prior to Testing
Provide list(s) of students to
proctor
Help develop seating
arrangements
Plan for any special testing
arrangements
Review schedule
Prepare students for MAP testing
Partnering to help all kids learn Revised 6/26/2003 22
Handbook— Pages 8-9
Reminders for Teachers
Other Important Reminders
Students cannot use
– Textbooks
– Other materials
– Hand-held calculators
Discuss importance of listening to
directions
Discuss importance of doing their
best on the test(s)
Partnering to help all kids learn Revised 6/26/2003 23
Talking to Students Before
Testing
Purpose – to find out exactly where each
of them are performing
Not expected to know the answer to
every question
Must answer every question – cannot skip
Cannot go back (because of adaptive
nature of test)
Need to know how to use a pop-up
calculator and scroll bar
Use MAP Student Presentation –
http://www.nwea.org/resources.htm
Partnering to help all kids learn Revised 6/26/2003 Handout — Guide to24Talking to
Students about the Test
Allowable Accommodations
No reading any part of language usage
or reading test
May help with a difficult word in math
as long as no additional clues are given
If IEP allows test to be read to student,
this may be done in math or science
If one-on-one testing is needed for a
student, plan ahead
Handbook— Pages 10 Allowable
Partnering to help all kids learn Revised 6/26/2003 25
Accommodations and
Modifications
Day of Testing
Restroom and drink break before
lab
Students bring book to read after
test
Be there on time
Help seat students at assigned
stations
Remain in lab during testing
Handbook— Pages 11-12
Partnering to help all kids learn Revised 6/26/2003 26
Proctor’s Duties During
Testing
Demo of TestTaker
Application
Partnering to help all kids learn Revised 6/26/2003 28
Handbook— Page 17
Student Score Log Sheet
MAP Reports
Teacher Reports (48 hours)
Class Reports
Individual Student Reports
School Summary Reports
District Summary Reports
Partnering to help all kids learn Revised 6/26/2003 29
Handbook— Page 19
MAP Reports
What’s the difference between
MAP classroom reports?
Teacher Report Class Report
Accessible to teacher after Accessible to district coordinator 72
48 hours hours after district testing declared
complete
Goal area descriptors Goal descriptors and/or RIT ranges
No Lexiles (if purchased) Includes Lexiles (if purchased)
Results for current season Results show historical data
only
Accessible via Internet to Not accessible via Internet to teacher
teacher (distributed by district coordinator)
Partnering to help all kids learn Revised 6/26/2003 30
Accessing MAP Teacher
Reports
Teachers receive user name and
password from building principal
Go to https://reports.nwea.org and
use appropriate user name and
password
Must have Adobe Acrobat Reader
loaded on computer to open the file
Handout — Guide to
Partnering to help all kids learn Revised 6/26/2003 31
Accessing Teacher Level
Reports
Accessing Teacher Reports
Reports.nwea.org
Preliminary
( )
Handout — Sample
Teacher Report
Choose your class and click .
Individual
Student
Progress
Report
(available
to
teachers)
Handout — Sample Individual Student
Progress Report; Annotated Report
Sample Class Report
(Final)
Partnering to help all kids learn Revised 6/26/2003 43
NOTE: If
using goal
descriptors,
they ARE
{
{ grade
{ dependent
RIT not grade level dependent
Percentile – grade level dependent
(NWEA norm)
Invalidations and Retesting
Reasons to invalidate a test
Invalid test events
– *** on report, no scores
Retesting
– Within testing window
– Invalid scores
– Absent students
Partnering to help all kids learn Revised 6/26/2003 45
Handbook— Pages 13-14
Invalid Scores and Retesting
Communicating with
Students and Parents
RIT Reference
Chart
Goal structures
Handbook— Page 20
Communicating with Parents
and Students
Partnering to help all kids learn Revised 6/26/2003 46
Handout — RIT Reference
Chart; Goal Strand Structure
Individual
Student
Progress
Report
(available
to
teachers
with
teacher
reports)
Partnering to help all kids learn Revised 6/26/2003 47
NWEA Monitoring Growth
Document
What are expected
RIT and growth
scores?
Partnering to help all kids learn Revised 6/26/2003 48
Monitoring Growth in
Student Achievement
Reading Achievement and Growth
Fall Spring Mean Growth
Fall Spring
Ending Fall to to to
Grade Median Mean Median Mean Grade Spring Fall Spring
2 179 177.7 188 186.6 2 14.9 n/a
3 191 188.7 200 197.9 3 10.5 11.9 14.1
4 200 198 206 204.6 4 7.4 7.6 10.7
5 207 205.2 213 210.8 5 6.3 7 8
6 212 210.5 217 215.3 6 5.3 5.3 6.1
7 216 214.4 221 219.1 7 4.3 4.3 5.3
8 220 218.3 225 223.2 8 4.2 4.3 4.6
9 223 221 226 224.2 9 2.9 3 3.8
Partnering to help all kids learn
10 225 223.1 Revised229.2
231 6/26/2003 10 2.6 3.3 3.6 Growth in
Handout — Monitoring 49
Student Achievement
NWEA Learning Continuum
A useful tool for
assisting in
instructional
development
Can use in goal 1.01
setting for students
Helpful for flexible
grouping planning
Partnering to help all kids learn Revised 6/26/2003 50
RIT
to
move to Proctor Administration Menu.
On Macs, use to
move to Proctor Administration Menu. Returns you back to the
test in progress.
You can add a comment
DURING the test event
regarding any issues you
feel recording. Allows you to shut down the test,
either to RESUME or NOT TO This is a list of pre-defined codes for
RESUME. invalidation purposes. By selecting one of
IMPORTANT NOTE: Only use these codes, the test will
resume if you intend to bring the AUTOMATICALLY be invalidated.
student back into the test, Some examples could be “Student refused
otherwise this shows up as an to take the test” or “Student was
“incomplete test event”, which cheating”.
Partnering to help all makes it
kids learn appear as data is missing.
Revised 6/26/2003 66
These are PRELIMARY scores
ONLY!!! Class reports will have
the FINAL scores.
Partnering to help all kids learn Revised 6/26/2003 67