2011 2012NAEPProgramInternationalAssessments by hY7s1p0X


									2011-2012 NAEP Program
International Assessments
District Assessment Coordinator

Annual Meeting

September 7, 2011

Michele Sonnenfeld

Race to the Top - NAEP
Florida’s Key Goal #3

   •   Increase the percentage of students scoring at or above proficient on NAEP

       by 2015, to or beyond the performance levels of the highest-performing states.

   •   Florida aims to go beyond setting goals for moving students to basic levels on NAEP, focusing on moving
       more students to proficiency and advanced levels.
                2011-2012 NAEP Program
                           Schools find       Complete and      Calls to    PAV Packets Arrive     PAV visits Begin   Assessment
                           out if they have   submit School     Submit          at Schools                             Window
                           been chosen        Info Forms        PAV Begin

Age 13 LTT                 5/1/2011           ASAP              8/29/2011   Depends on when           9/6/2011        10/10/2011-
                                                                             Schools or DACs                          12/16/2011
                                                                            furnish student list
                                                                             so the school can
                                                                                be sampled
Age 9 LTT                  5/1/2011           9/16/2011         12/5/2011        1/3/2012            12/12/2011        1/9/2012-
Gr. 4 and 12 NAEP          5/1/2011           9/30/2011         1/16/2011        1/3/2012             1/5/2012        1/23/2012-
Age 17 LTT                 5/1/2011           1/28/2011         1/30/2012        2/4/2012             2/6/2012        3/19/2012-
Pre-pilot of
Technology and
Engineering Literacy
(TEL) Tasks
PISA – Age 15 (born                           Receive Student   Calls to                             PAV Visits       Assessment
between July 1, 1996 and                      Listing Form      set PAV                                begin           Window
June 31, 1997)
National Dates:                                                 Begin
Sate Mailing               9/26/2011          8/15/2012         8/27/2012                            9/4/20121       10/1/2012-
District-Mailing           10/15/11
School Mailing wave 1      10/7/2011
School wave 1 first        10/22/2011

                     Can begin once we have school sampled and tracking form produced/back to school
NAEP 2011 Results
  •   October 2011 – Reading and Mathematics, grades 4 and 8

  •   November 2011 – Reading and Mathematics, grades 4 and 8, Miami-Dade and Hillsborough County Public

  •   Spring 2012 – Science, grade 8, State and District-level results

Inclusion on NAEP
  •   National Assessment Governing Board (NAGB) issued a Policy Statement on NAEP Testing and Reporting on
      SD and ELL on March 6, 2010

  •   Policy intended to maximize student participation, minimize potential for bias, promote fair comparisons
      between states, and maintain trends

  •   Lori Rodriguez, Bureau Chief, Student Achievement Through Language Acquisition; and Karen
      Denbroeder, Senior Educational Program Director of the office of Program Accountability, Assessment &
      Data Systems, Exceptional Education and Student Services, assisted with encouraging including more
      students to be included in NAEP

New Inclusion Guidelines for NAEP
  •   Proportion of all students excluded from NAEP sample should not exceed 5%

  •   85% of students classified as either ELL or SD must be included in the NAEP

ELL and SD Participation in NAEP
  •   Allows SD and ELLs to experience a large-scale assessment administration w/o high-stakes consequences

  •   SD and ELLs are provided with accommodations so they can demonstrate their content knowledge and
      skills on NAEP

  •   NAEP does not allow the use of a word-to-word dictionary on NAEP Reading

Pre-Pilot of Technology and Engineering Literacy (TEL) Tasks
  •   Will take approximately 90 minutes to complete

  •   30 students per school

  •   Two sessions of 15 students per school
    •   Last 2 weeks in March (March 19 – March 30, 2012)

    •   Students will take 2-3 scenario-based tasks on a computer provided by NAEP

    •   Tasks are designed to be 10, 20, or 30 minutes long

    •   Approximately 10 schools in Florida will be selected to participate

Technology and Engineering Literacy Framework for the 2014 NAEP
This slide shows a picture of a Circular logo with a triangle inside it. Along the inside edge of the circle are three
different phrases: “Understanding Technological Principles; Developing Solutions and Achieving Goals;
Communication and Collaborating”. The triangle is divided into three segments, each segment containing a
different phrase to correspond and be interchangeable with the outside phrases. They are as follows: “Design and
Systems; Information and Communication Technology; Technology and Society”.

The assessment targets are organized into three major areas of technology and engineering literacy, each
corresponding to a broad body of knowledge and skills with which students should be familiar.


Best Practices Guides
    •   Will be provided to the 24 schools participating in the Grade 12 NAEP and the 21 schools participating in
        the 17-year-old LTT

    •   Will be mailed mid-November either to the district office or directly to the schools, as designated by the

    •   Purpose is to provide motivational materials to encourage the older students to participate in the
        assessment in a meaningful way

NAEP Assessment Schedule
2013 and 2014
    •   2013 – TUDA, State, and National Reading and Mathematics, grades 4 and 8. National and 11 states,
        including Florida, Reading and Mathematics, grade 12; National grade 4 Writing

    •   2014 – National Civics, Geography, U.S. History, and Technology and Engineering Literacy

Florida State Statute, Revised by 2011 Legislature
1008.22 Student assessment program for public schools.
(2) NATIONAL AND INTERNATIONAL EDUCATION COMPARISONS.—It is Florida's intent to participate in the
measurement of national educational goals. The Commissioner of Education shall direct Florida school districts to
participate in the administration of the National Assessment of Educational Progress, or a similar national or
international assessment program, both for the national sample and for any state-by-state comparison programs
which may be initiated.

International Assessments , cont.
    •    Florida will participate in benchmarking studies for Trends in International Mathematics and Science Study
        (TIMSS), Progress in International Reading Literacy Study (PIRLS), and the Program for International
        Student Assessment (PISA).

    •   Todd Clark, Director, Race to the Top Assessments, is responsible for managing Florida’s contract with
        Westat for TIMSS, PIRLS, and PISA.

    •    Michele Sonnenfeld is responsible for the coordination piece of the international assessments, just as she
        is for NAEP.

International Assessments
    •   Enable the U.S. to benchmark its performance to that of other countries

    •   Each is designed to serve a different purpose

    •   Each is based on a separate and unique framework and set of assessment items

    •   Participation in international assessments to measure state progress is required by Florida’s RTTT

Race to the Top (RTTT)
Initiative 2, RTTT Activities

Florida will increase resources for teachers to perform effective instruction through high-quality assessments by
providing information that allows international comparisons of student achievement in Science, Technology,
Engineering, and Mathematics (STEM) and literacy.

Race To The Top (RTTT), cont.
    •    Areas of need revealed by these measures will allow Florida to adjust priorities for development of
        resources and strategies prior to the initiation of the internationally-benchmarked common summative
        assessments of the Common Core State Standards (CCSS).
TIMSS 2011
Trends in International Mathematics and Science Study (TIMSS)

      Measures student learning in mathematics and science since 1995
      Administered at grades 4 and 8 every           4 years in the spring
      U.S. and Florida data will be compared to that of other countries
      Results released in late 2012 or early 2013
      See handout for results from 2007
      http://timss.bc.edu/timss2007/PDF/TIMSS2007_InternationalScienceReport.pdf
      http://timss.bc.edu/timss2007/mathreport.html

PIRLS 2011
      Progress in International Reading Literacy Study (PIRLS)
      Measures both trends in fourth-grade students’ reading literacy achievement, as well as school and
       teacher practices related to reading instruction since 2001
      Administered every 5 years in the spring.
      U.S. and Florida data will be compared to that of other countries
      Results released in late 2012 or early 2013
      See handout for results from 2006
      http://timss.bc.edu/PDF/PIRLS2006_international_report.pdf

TIMSS and PIRLS Participation
   •   Slide shows a map of the United States indicating which states participated, with California, Colorado,
       Minnesota, Indiana, Alabama, Massachusetts and Rhode Island, indicated as NAEP-TIMMS Linking Study
       Validation Sates; and North Carolina indicated as the only NAEP-TIMMS Linking Study Validation Sates also
       participating in grade 4 state TIMMS; and Florida indicated as the only state participating in state level
       TIMMS (Grades 4 and 8) and PIRLS at their own expense.

PISA 2012
Program for International Student Assessment (PISA)

      Measures how far students approaching the end of compulsory education (15-year-olds) have acquired
       some of the knowledge and skills essential for full participation in an information society
      Administered every 3 years in the fall.
      U.S. and Florida data will be compared to that of other countries
      Results released in late 2013 or early 2014
      See handout for results from 2009
      http://browse.oecdbookshop.org/oecd/pdfs/free/9810071e.pdf
PISA 2012 cont.
   •   Will be administered September 24 to November 2, 2012

   •   Focus will be on Mathematics

   •   Reading and Scientific Literacy will also be assessed

   •   Separate national and state samples

   •   Approximately 10 FL schools will be selected for the national sample and 50 FL schools for the state sample

PISA 2012 cont.
   •   School PISA coordinators will be invited to attend an informational meeting in DC that will include
       education experts from the U.S. and from other countries

   •   Westat staff will administer PISA, the same as with NAEP

For additional information about the International Assessments, please access


For additional information about the 2011-2012 Program, including the Long-term Trend Assessment, please access



Social Networking
   •   Twitter www.twitter.com/NAEP_NCES

   •   Facebook www.facebook.com/NationalAssessmentofEducationalProgress

Social Networking

Learn more about:

      The latest news regarding upcoming assessments and releases;
      Tips for using online NAEP tools;
      NAEP questions to test your knowledge compared to that of the nation’s students; and
      NAEP publications
Florida NAEP State Coordinator
Michele Sonnenfeld

325 W. Gaines Street, Room 414

Tallahassee, FL 32399




To top