Business Rule Definition Worksheet by jcb11704

VIEWS: 0 PAGES: 31

More Info
									                 Choosing a Common Language: Terms and Definitions Used in the State Performance Plan (SPP)
                                        and the Annual Performance Report (APR)
Term                               Definition                      Part C Example                  Part B Example                      SPP/APR References and Notes
Accurate data         The extent to which data are              N/A                          N/A                           Refer to SPP/APR Submission Tools on the SPP/APR
                      reported according to applicable                                                                     Calendar: for Part B (click here); for Part C (click here).
                      guidelines.
                                                                                                                           Materials include, but are not limited to:
                                                                                                                               Part B Indicator Measurement Table
                                                                                                                               B20 Rubric
                                                                                                                               Part C Indicator Measurement Table
                                                                                                                               C14 Rubric

                                                                                                                           Note: Requirement—Indicator B-20 and C-14: State reported data
                                                                                                                           (618 and State Performance Plan and Annual Performance
                                                                                                                           Report) are timely and accurate. (20 U.S.C. 1416(a)(3)(B) and
                                                                                                                           1442)
Actual target data    For the Annual Performance Report         For a compliance             For a compliance              Refer to SPP/APR Submission Tools on the SPP/APR
                      (APR), the actual data relative to the    indicator, the state’s       indicator, the state’s        Calendar: for Part B (click here); for Part C (click here).
                      target for the given indicator for the    target was 100%              target was 100%
                      Federal Fiscal Year (FFY) covered         compliance but the           compliance but the            Materials include, but are not limited to:
                      by the APR.                               state’s actual level of      state’s actual level of           Part B Instruction Sheet
                                                                compliance was only          compliance was only               Part C Instruction Sheet
                                                                80%.                         80%.
Aggregated/           Aggregated data are compiled              Data on IFSPs                Data on students in
disaggregated data    across all variables or breakdowns        completed within             separate schools are
                      available for the data. Disaggregated     timelines are aggregated     aggregated for all
                      data are separated or broken down         for all infants/toddlers     students in the state. Data
                      by a designated variable.                 in the state. Data on        on students in separate
                                                                IFSPs completed with         schools are disaggregated
                                                                timelines are                by LEA to determine the
                                                                disaggregated by EI          percentage of students in
                                                                program to determine         separate schools for each
                                                                the percentage of IFSPs      LEA.
                                                                within timeline for each
                                                                program.
Baseline              Starting point or initial level of data   For a given indicator, if    For a given indicator, if     Refer to SPP/APR Submission Tools on the SPP/APR
                      on the indicator against which future     the state’s starting point   the state’s starting point    Calendar: for Part B (click here); for Part C (click here).
                      targets and actual performance data       was 50% in FFY 2004,         was 50% in FFY 2004,


                     (Reviewed/revised by the RRCP Data Priority Team and the State Data Managers Feedback Group after the June 2008 Data Meeting)
                                                                        Revised August 2009
Term                             Definition                     Part C Example                Part B Example                       SPP/APR References and Notes
                     will be compared.                      FFY 2004 was the             FFY 2004 was the             Materials include, but are not limited to:
                                                            ―baseline‖ year against      ―baseline‖ year against          Part B Instruction Sheet
                                                            which future Actual          which future Actual              Part C Instruction Sheet
                                                            Target Data will be          Target Data will be
                                                            compared.                    compared.
Business rule        A business rule governs what the       The business rule will       The business rule will not
                     data should include. It sets up        not allow the person         allow the person entering
                     parameters that determine how data     entering data to enter a     data to enter an exit date
                     will be collected and reported. The    start date for Part C        for a student if the
                     rules can be ―enforced‖ at the point   services that is after the   student is 16 years of age
                     of data entry or by running data       child’s third birthday.      or older and the date for
                     through a series of coded edit                                      the secondary transition
                     checks or ―error traps.‖                                            meeting is ―missing.‖

Census/population    When using surveys in the              For Indicator C-4            For Indicator B-14 (Post-
                     SPP/APR as a data collection           (Family Outcomes), if        School Outcomes), if the
                     strategy, the census approach refers   the census approach          census approach were
                     to sending the survey to the total     were used, the survey        used, the survey would
                     population.                            would be sent to all of      be sent to all of the
                                                            the parents of infants       exiting students with
                                                            and toddlers with            disabilities, the year
                                                            disabilities who have        following their exit from
                                                            been receiving Part C        special education.
                                                            services for at least 6
                                                            months.
Cell size            Cell size is the number reported in    Number of children in        Number of removals for
                     response to a particular question.     the state receiving Part     drugs in the state for
Related term:        For work related to IDEA data          C services in the home       students with emotional
Minimum cell size    collection and the SPP/APR, cell       setting on December 1,       disturbance, school year
                     size typically refers to number of     2007 = 103.                  2007-2008 = 12.
                     students or frequency of events that   (Cell size is 103.)          (Cell size is 12.)
                     meet a certain set of criteria.

Complete data        For submission in the APR,             For example, when the        For example, when the        Refer to SPP/APR Submission Tools on the SPP/APR
                     complete data are required. No         instructions for an          instructions for an          Calendar: for Part B (click here); for Part C (click here).
                     missing sections and no placeholder    indicator require data       indicator require data

                                                                                                                                                                                    2
                                                 Choosing a Common Language: Terms and Definitions Used for the SPP/APR
                    (Reviewed/revised by the RRCP Data Priority Team and the State Data Managers Feedback Group after the June 2008 Data Meeting)
                                                                        Revised August 2009
Term                                 Definition                    Part C Example              Part B Example                         SPP/APR References and Notes
                       data should be submitted. Data for       broken down into           broken down into              Materials include, but are not limited to:
                       all applicable districts or agencies     subparts, data for all     subparts, data for all            B20 Rubric
                       are submitted.                           subparts must be           subparts must be                  C14 Rubric
                                                                provided.                  provided.
                       Note: Validity and reliability of data
                       cannot be determined when
                       incomplete data are submitted.
Compliance             Adherence to specific requirements
                       in IDEA 2004 and IDEA
                       Regulations.
Compliance             In the SPP/APR, indicators where         Part C Compliance          Part B Compliance             Refer to SPP/APR Submission Tools on the SPP/APR
indicators             100% compliance is the                   Indicators are:            Indicators are:               Calendar: for Part B (click here); for Part C (click here).
                       requirement.                             C-1, C-7, C-8, C-9, C-     B-9, B-10, B-11, B-12,
See notes for term                                              10, C-11,                  B-13, B-15, B-16, B-17,       Materials include, but are not limited to:
“Determinations”       Exception: For Indicators B-9 and        C-14                       B-20                              Part B Indicator Measurement Table
                       B-10, 0% compliance is the                                                                            B20 Rubric
                       requirement.                                                                                          Part C Indicator Measurement Table
                                                                                                                             C14 Rubric

Confidence             In statistics, a confidence interval     Note: Example below applies to both Part C and Part
interval/confidence    (CI) is the limits within which a        B.
level                  population value lies. Instead of
                       estimating the value with a single       For example, in a poll of election voting-intentions,
                       point, an interval is used.              a single point estimate might state that 49% of voters
                       Confidence intervals are used when       favor a candidate. A CI of ± 3% around the point
                       estimates are made about a               estimate with a 95% confidence level, means that the
                       population based on a sample of the      estimate of the population intent to vote for the
                       population. Confidence intervals         candidate, based on the sample, would be between
                       are accompanied by the degree or         46% and 52%.
                       level of confidence (confidence
                       level or confidence coefficient) that
                       the value falls within the limits. The
                       most common confidence levels are
                       .95 and .99.
Correct calculation    Result produced accurately follows       N/A                        N/A                           Refer to SPP/APR Submission Tools on the SPP/APR
                       the required calculation in the                                                                   Calendar: for Part B (click here); for Part C (click here).

                                                                                                                                                                                       3
                                                   Choosing a Common Language: Terms and Definitions Used for the SPP/APR
                      (Reviewed/revised by the RRCP Data Priority Team and the State Data Managers Feedback Group after the June 2008 Data Meeting)
                                                                          Revised August 2009
 Term                               Definition                   Part C Example              Part B Example                       SPP/APR References and Notes
                      instructions for the indicator.                                                                Materials include, but are not limited to:
                                                                                                                         Part B Instruction Sheet
                                                                                                                         Part C Instruction Sheet

Correction of         In order for a state to report that     The state verifies         If an SEA determines that   Refer to SPP/APR Submission Tools on the SPP/APR
noncompliance         previously identified noncompliance     through follow up          an LEA is not in            Calendar: for Part B (click here); for Part C (click here).
                      has been corrected in a timely          review of data, other      compliance with the
Related terms:        manner, the state must have first       documentation, and/or      requirement to make         Materials include, but are not limited to:
Identification of     done the following:                     interviews that the        placement decisions             OSEP Timely Correction Memo 09-02/Reporting
noncompliance &                                               noncompliant policies,     consistent with the least            on Correction of Noncompliance (click here).
Timely Correction.    Account for all noncompliance           procedures, and/or         restrictive environment         B15 Worksheet
                      whether collected through the           practices have been        requirements of the Act,        C9 Worksheet
See also Finding.     State’s on-site monitoring system,      revised and the            the SEA would be                Definitions of terms commonly used in
                      other monitoring process such as        noncompliance has          expected to require                  monitoring (e.g., finding, correction of
                      self-assessment or desk audit, State    been corrected.            corrective action and                noncompliance, enforcement action), 8/23/07
                      complaint or due process hearing                                   verify correction by                 (click here).
                      decisions, State data system,           The state should notify    determining that the LEA
                      statewide representative sample or      the Early Intervention     corrected any               Also, for a more specific definition of a finding, refer to the
                      618 data or identified by OSEP or       (EI) program in writing    noncompliant policies,      term in OSEP FAQ on Identification and Correction,
                      the Department;                         that the noncompliance     procedures, or practices,   9/3/08 (click here).
                                                              is corrected.              and that placement teams,
                      Identify in which LEAs or EIS                                      subsequent to those
                      programs noncompliance occurred,        For the purposes of the    changes, were making
                      what the level of noncompliance         SPP/APR reporting,         placement decisions
                      was in each of those sites, and the     timely correction occurs   consistent with the
                      root cause(s) of the noncompliance;     when noncompliance is      requirements of the Act.
                                                              corrected and verified
                      If needed, change, or require each      as soon as possible but    The state should notify
                      LEA or EIS program to change, its       no later than one year     the LEA in writing that
                      policies, procedures and/or practices   from the notification of   the noncompliance is
                      that contributed to or resulted in      noncompliance.             corrected.
                      noncompliance; and
                                                              States should also         For the purposes of the
                      Based on its review of updated data,    report whether the EIS     SPP/APR reporting,
                      which may be from subsequent on-        program subsequently       timely correction occurs
                      site monitoring, determine, in each     corrected the              when noncompliance is

                                                                                                                                                                                   4
                                                  Choosing a Common Language: Terms and Definitions Used for the SPP/APR
                     (Reviewed/revised by the RRCP Data Priority Team and the State Data Managers Feedback Group after the June 2008 Data Meeting)
                                                                         Revised August 2009
Term                                  Definition                   Part C Example              Part B Example                      SPP/APR References and Notes
                        LEA or EIS program with identified      noncompliance (i.e.,      corrected and verified as
                        noncompliance, that the LEA or EIS      beyond the one year       soon as possible but no
                        program was, within one year from       timeline).                later than one year from
                        identification of the noncompliance,                              the notification of
                        correctly implementing the specific                               noncompliance.
                        statutory or regulatory
                        requirement(s).                                                   States should also report
                                                                                          whether the LEA
                        If an LEA or EIS program did not                                  subsequently corrected
                        correct identified noncompliance in                               the noncompliance (i.e.,
                        a timely manner (within one year                                  beyond the one year
                        from identification), the State must                              timeline).
                        report on whether the
                        noncompliance was subsequently
                        corrected. Further, if an LEA or
                        EIS program is not yet correctly
                        implementing the
                        statutory/regulatory requirement(s),
                        the State must explain what the
                        State has done to identify the
                        cause(s) of continuing
                        noncompliance, and what the State
                        is doing about the continued lack of
                        compliance including, as
                        appropriate, enforcement actions
                        taken against any LEA or EIS
                        program that continues to show
                        noncompliance.
Corrective action       A plan that outlines the actions that   If a finding of           If a finding of              (Click here) to access the document Developing and
plan (CAP)              the state or local program will take    noncompliance was         noncompliance was made       Implementing an Effective System of General Supervision:
                        to correct findings of                  made regarding            regarding Indicator B-11     Part B, NCSEAM, (January 2007); go to page 14.
                        noncompliance in a timely manner        Indicator C-7             (Child Find), a Corrective
Related term:           (i.e. as soon as possible and in no     (Timeliness of IFSP), a   Action Plan for an LEA       Additional resource:
Improvement plan.       case more than one year of the date     Corrective Action Plan    would detail what                Final CAP/IP Checklist (click here)
                        of notification). Corrective Action     for a local program       specific actions (e.g.
See also Enforcement    Plans (CAPs) are most effective         would detail what         changes in policies or

                                                                                                                                                                              5
                                                    Choosing a Common Language: Terms and Definitions Used for the SPP/APR
                       (Reviewed/revised by the RRCP Data Priority Team and the State Data Managers Feedback Group after the June 2008 Data Meeting)
                                                                           Revised August 2009
Term                          Definition                      Part C Example             Part B Example                         SPP/APR References and Notes
actions.        when they emphasize measurable            specific actions (e.g.     practices, professional
                results and include changes needed        changes in policies or     development, targeted
                in (1) practices (and related policies    practices, professional    technical assistance,
                and procedures), (2) professional         development, targeted      supervision, etc.) that the
                development, (3) targeted technical       technical assistance,      LEA would take to
                assistance, (4) infrastructure, and (5)   supervision, etc.) that    ensure that the
                sufficient supervision.                   the program would take     noncompliance was
                                                          to ensure that the         corrected.
                                                          noncompliance was
                                                          corrected.
Data            Comparing present levels of system        An analysis of child       An analysis of state          No specific use of data analysis as a term in the SPP/APR.
analysis        performance to baseline and targets       identification rates       graduation rates              ―Analysis‖ is used more generally in reference to both
                and an examination of trend data          disaggregated by a local   disaggregated by school       qualitative and quantitative study of data, trends, dispute
                over time in order to identify            EI program would           district across a number      resolution issues, etc.
                strengths, weaknesses and areas for       indicate the variability   of variables. For
                improvement and draw conclusions          across programs and        example, graduation rates
                by systematically examining why           help to determine which    could be examined for
                targets were or were not reached.         programs were under-       districts with and without
                                                          identifying infants and    dropout prevention
                                                          toddlers with              programs.
                                                          disabilities compared to
                                                          the state average.
Data quality    Refers to the extent to which IDEA
                data (616 and 618) are judged to be
                timely, accurate, valid, reliable, and
                useful.
Desk audit      Refers to review of data done from        The Part C program has     LEAs submit their 618         The term ―desk audit‖ is used in the Part B and Part C
                the SEA/Lead Agency (or from a            a statewide individual     data electronically to the    Indicator Measurement Tables. Go to last column
                secure computer) rather than onsite       child record system that   SEA and edit checks are       ―Instructions for Indicators/Measurement‖ for Indicators B-
                at the LEA/EI program. It refers to       permits the Lead           done when data are            15 and C-9. To access the Measurement Table, refer to
                data that can be examined using an        Agency to determine        submitted. The SEA            SPP/APR Submission Tools on the SPP/APR Calendar:
                electronic database or data sent to       what percentage of         reviews the data              for Part B (click here); for Part C (click here).
                the SEA/Lead Agency                       children in each EI        submission records and
                electronically. This term may also        program had an             edit checks to determine
                refer to review of monitoring data        evaluation and             which LEAs have timely
                sent to the SEA/Lead Agency in            assessment and an          and accurate data.

                                                                                                                                                                             6
                                            Choosing a Common Language: Terms and Definitions Used for the SPP/APR
               (Reviewed/revised by the RRCP Data Priority Team and the State Data Managers Feedback Group after the June 2008 Data Meeting)
                                                                   Revised August 2009
Term                           Definition                     Part C Example            Part B Example                      SPP/APR References and Notes
                  hard copy (e.g., paper self             initial IFSP within the
                  assessments).                           45-day timeline
                                                          (Indicator C7) without
                                                          doing a review of child
                                                          records on site.
Determinations    As required in IDEA 2004 § 616,         Levels of determination   Levels of determination   Section 616(d) Department’s Review and §616
                  based on the information provided       as required by IDEA §     as required by IDEA §     Determination Criteria 9-14-06, referred to as the Green
                  by the state in the state performance   616 include:              616 include:              Sheet (click here).
                  report, information obtained through
                  monitoring visits, and any other        Meets Requirements        Meets Requirements        OSEP Timely Correction Memo 09-02/Reporting on
                  public information made available,      Needs Assistance          Needs Assistance          Correction of Noncompliance (click here).
                  the Secretary shall determine the       Needs Intervention        Needs Intervention
                  state’s status.                         Needs Substantial         Needs Substantial         Determinations of the Status of Local Programs by State
                                                          Intervention              Intervention              Agencies Under Parts B and C of the
                  Similarly, states are required to                                                           Individuals with Disabilities Education Act (IDEA), March
                  enforce the IDEA by making                                                                  2007 (click here)
                  ―determinations annually under
                  IDEA section 616(e) on the                                                                  Also, refer to OSEP Determination Documents on the
                  performance of each LEA under                                                               SPP/APR Calendar: for Part B (click here); for Part C
                  Part B and each EI program under                                                            (click here).
                  Part C.‖
                                                                                                                  How the Department Made Determinations under
                  Factors that must be considered:                                                                 Section 616(d) of the Individuals with Disabilities
                   Performance on compliance                                                                      Education Act in 2008: Part B (June 2009); and
                      indicators                                                                                  How the Department Made Determinations under
                   Whether data submitted are                                                                     Sections 616(d) and 642 of the Individuals with
                      valid, reliable and timely                                                                   Disabilities Education Act in 2008: Part C (June
                   Uncorrected noncompliance                                                                      2009)
                      from other sources
                   Any audit findings                                                                        Note: Beginning with 2010 determinations, OSEP will no longer
                                                                                                              consider a State to be in substantial compliance relative to a
                                                                                                              compliance indicator based on evidence of correction of the
                  In addition, states could also
                                                                                                              previous year’s noncompliance if the State’s current year data for
                  consider:                                                                                   that indicator reflect a very low level of compliance (generally
                   Performance on result                                                                     75% or below): and will credit a State with correction relative to
                       indicators; and                                                                        child-specific compliance indicator only if the State confirms that
                   Other information.                                                                        it has addressed each instance of noncompliance identified in the

                                                                                                                                                                                7
                                              Choosing a Common Language: Terms and Definitions Used for the SPP/APR
                 (Reviewed/revised by the RRCP Data Priority Team and the State Data Managers Feedback Group after the June 2008 Data Meeting)
                                                                     Revised August 2009
Term                                Definition                      Part C Example             Part B Example                        SPP/APR References and Notes
                                                                                                                       data for an indicator that was reported in the previous year’s APR,
                                                                                                                       as well as any noncompliance identified by the Department more
                                                                                                                       than one year previously (Source: OSEP Memo 09-02 dated
                                                                                                                       10/17/08; Reporting on Correction of Noncompliance in the
                                                                                                                       Annual Performance Report Required under Sections 616 and 642
                                                                                                                       of the IDEA).
Disproportionate       In the SPP/APR, States must define        N/A - Note:               A state identified 5 LEAs   (Click here) for a list of several Guidance Documents on
representation         ―disproportionate representation‖         Disproportionate          with disproportionate       Disproportionate Representation for Part B Indicators 9 &
                       for Indicator B-9&10.                     representation is not     representation based on a   10.
                       Disproportionate representation of        addressed in Part C of    review of statewide data.
                       racial and ethnic groups in special       the IDEA or in the        Then, based on a review     Documents include:
                       education and related services to the     SPP/APR.                  of LEA policies and          OSEP Policy Memo (07-09)/Disproportionality
                       extent the representation is the result                             procedures, the state        FAQ on Underrepresentation and Disproportionality
                       of inappropriate identification.                                    identified only 1 LEA        Side-by-Side: Disproportionate Representation and
                                                                                           where it was determined        Significant Disproportionality
                       A State’s definition of                                             that disproportionate        Methods for Assessing Racial/Ethnic
                       disproportionate representation must                                representation was the         Disproportionality in Special Education, DAC
                       include both overrepresentation and                                 result of inappropriate
                       underrepresentation.                                                identification.             Note: States are required to address disproportionate
                                                                                                                       representation that is the result of inappropriate identification in
                                                                                                                       SPP Indicators 9 and 10. Under these indicators, which are based
                                                                                                                       on statutory language at 20 U.S.C. 1416(a)(3)(C), states are
                                                                                                                       required to review the LEAs in the state to determine the extent to
                                                                                                                       which the disproportionate representation of racial and ethnic
                                                                                                                       groups in special education is the result of inappropriate
                                                                                                                       identification (Source: OSEP Memo 07-09, Disproportionality of
                                                                                                                       Racial and Ethnic Groups in Special Education).
Drill down             Process through which data are            For Indicator C-1         For Indicator B-12 (Part    Note: This term is not referenced in the SPP/APR
                       disaggregated and examined for            (Timely Service           C to B Transition),         Information Collections 1820-0624, 1820-0677, and 1820-
Related term:          possible cause-effects and other          Delivery),                disaggregation of the       0659.
Root cause analysis    interpretive conclusions.                 disaggregation of the     statewide compliance
                                                                 statewide compliance      percentage by LEA
                                                                 percentage to the local   across the state in order
                                                                 program level in order    to determine which
                                                                 to determine which        school districts
                                                                 programs demonstrated     demonstrated a greater or
                                                                 a greater or lesser       lesser degree of
                                                                 degree of compliance.     compliance.
                                                                                                                                                                                         8
                                                   Choosing a Common Language: Terms and Definitions Used for the SPP/APR
                      (Reviewed/revised by the RRCP Data Priority Team and the State Data Managers Feedback Group after the June 2008 Data Meeting)
                                                                          Revised August 2009
Term                                 Definition                   Part C Example                Part B Example                          SPP/APR References and Notes
Enforcement            Actions taken by the SEA or LA         Examples of                  Examples of enforcement        Definitions of terms commonly used in monitoring (e.g.,
actions                against an LEA or an EI Program        enforcement actions          actions that the SEA           finding, correction of noncompliance, enforcement action),
                       that has not corrected                 that the Part C Lead         might take are to direct       8/23/07 (click here). Also, for a more specific definition of
See also Corrective    noncompliance within one year          Agency might take are        the use of funds, require      a finding, refer to the term in OSEP FAQ on Identification
action plan (CAP) &    from its identification and that are   to direct the use of local   the development of a           and Correction, 9/3/08 (click here)
Improvement plan.      designed to promptly bring the LEA     EI program dollars,          Corrective Action Plan,
                       or the EI program into compliance.     require the development      or withhold state or           Section 616(d) Department’s Review and §616
                                                              of a Corrective Action       federal funds.                 Determination Criteria 9-14-06, referred to as the Green
                                                              Plan or withhold state                                      Sheet (click here)
                                                              or federal funds.            Examples of Federal
                                                                                           Enforcement Actions:
                                                              Examples of Federal          recover funds, withhold
                                                              Enforcement Actions:         any further payments to
                                                              recover funds, withhold      the state, refer the case to
                                                              any further payments to      the Office of the
                                                              the state, refer the case    Inspector General, or
                                                              to the Office of the         refer the matter for
                                                              Inspector General, or        appropriate enforcement
                                                              refer the matter for         action.
                                                              appropriate
                                                              enforcement action
Evidence of            Documentation that noncompliance       If noncompliance was         If noncompliance was           Refer to SPP/APR Submission Tools on the SPP/APR
correction             has been corrected. Such               identified for Indicator     identified for Indicator B-    Calendar: for Part B (click here); for Part C (click here).
                       documentation must include             C-7, (Timeliness of the      13 (Secondary Transition
                       updated data, which may be             IFSP), evidence of           with IEP Goals),               Materials include, but are not limited to:
                       obtained from subsequent on-site       correction might             evidence of correction             OSEP Timely Correction Memo 09-02/Reporting
                       monitoring.                            include documentation        might include                           on Correction of Noncompliance (click here).
                                                              through record reviews       documentation through              B15 Worksheet
                                                              that all children referred   record reviews, that all           C9 Worksheet
                                                              before a designated date     students 16 or older have          Definitions of terms commonly used in
                                                              (for whom an initial         IEPs with measurable,                   monitoring (e.g., finding, correction of
                                                              IFSP had not been            annual IEP Goals and                    noncompliance, enforcement action), 8/23/07
                                                              developed) have an           transition services.                    (click here).
                                                              initial IFSP or have an
                                                              exceptional family                                          Also, for a more specific definition of a finding, refer to the
                                                              reason(s) for the delay.                                    term in OSEP FAQ on Identification and Correction,

                                                                                                                                                                                        9
                                                   Choosing a Common Language: Terms and Definitions Used for the SPP/APR
                      (Reviewed/revised by the RRCP Data Priority Team and the State Data Managers Feedback Group after the June 2008 Data Meeting)
                                                                          Revised August 2009
 Term                                  Definition                     Part C Example                Part B Example                       SPP/APR References and Notes
                                                                                                                           9/3/08 (click here)




                          According to the National                                                                        Note: Definition retrieved from the National
 Evidence-based           Implementation Research Network                                                                  Implementation Research (NIRN) Website Glossary of
                          (2007), evidence-based practice                                                                  Terms on February 27, 2009
                          refers to the skills, techniques, and                                                            http://www.fpg.unc.edu/~nirn/implementation/glossary.cfm
                          strategies used by practitioners
                          when applying the best available
                          research evidence in the provision
                          of health, behavior, and education
                          services to enhance outcomes.
 Federal fiscal year      The federal fiscal year on which         N/A                        N/A                          Refer to SPP/APR Submission Tools on the SPP/APR
 (FFY)                    data are being reported, July 1-June                                                             Calendar: for Part B (click here); for Part C (click here).
                          30. Federal fiscal years are
                          beginning numbered, e.g. FFY 2006                                                                Materials include, but are not limited to:
                          is 2006-07. In contrast, state fiscal                                                                Part B Instruction Sheet
                          years (SFY) are often forward                                                                        Part C Instruction Sheet
                          numbered, e.g. SFY 2006 is 2005-
                          06.

 Finding                  As used in SPP/APR Indicators B-         If the Part C Lead         If the SEA identified        Refer to SPP/APR Submission Tools on the SPP/APR
                          15 and C-9, a finding is a written       Agency identified          noncompliance with one       Calendar: for Part B (click here); for Part C (click here).
See also Correction of    notification from the state to a local   noncompliance with         of the SPP Compliance
noncompliance,            educational agency (LEA) or early        one of the SPP             Indicators through on-site   Materials include, but are not limited to:
Identification of         intervention (EI) program that           Compliance Indicators      monitoring of an LEA, it         B15 Worksheet
noncompliance &           contains the state's conclusion that     through on-site            would write a letter of          C9 Worksheet
Timely correction.        the LEA or EI program is in              monitoring of an EI        finding, explicitly              Definitions of terms commonly used in
                          noncompliance, and that includes         program, it would write    notifying the LEA that                monitoring (e.g., finding, correction of
                          the citation of the statute or           a letter of finding,       noncompliance had been                noncompliance, enforcement action), 8/23/07
                          regulation and a description of the      explicitly notifying the   identified and stating                (click here).
                          quantitative and/or qualitative data     EI program that            what the LEA needed to
                          supporting the state's conclusion        noncompliance had          do to correct the            Also, for a more specific definition of a finding, refer to the
                          that there is noncompliance with         been identified and        noncompliance.               term in OSEP FAQ on Identification and Correction,

                                                                                                                                                                                       10
                                                      Choosing a Common Language: Terms and Definitions Used for the SPP/APR
                         (Reviewed/revised by the RRCP Data Priority Team and the State Data Managers Feedback Group after the June 2008 Data Meeting)
                                                                             Revised August 2009
Term                                   Definition                     Part C Example              Part B Example                         SPP/APR References and Notes
                         that statute or regulation.              stating what the                                         9/3/08 (click here)
                                                                  program needed to do to
                                                                  correct the
                                                                  noncompliance.
Fiscal desk audit        A fiscal desk audit that focuses on                                                               Refer to OSEP Verification/Focused Monitoring on the
                         financial data.                                                                                   SPP/APR Calendar: for Part B (click here); for Part C
                                                                                                                           (click here).

                                                                                                                           Materials include, but are not limited to:
                                                                                                                                 CrEAG complete
                                                                                                                                 CrEAG General Supervision
                                                                                                                                 CrEAG Data
                                                                                                                                 CrEAG Fiscal
Focused monitoring       A proactive approach, which              A state determines          A state determines           (Click here) to access Focused Monitoring Information
(State and Local)        includes a purposeful selection of       through a stakeholder       through data analysis that
                         priority areas to examine for            process that improved       improved parent              Additional resources:
                         compliance/results while not             family outcomes is a        involvement is a priority          Focused Monitoring: A Model for the Present,
                         specifically examining other areas       priority and develops       and develops monitoring               July 2002 (click here) We suggest deleting this –
                         in order to maximize limited             monitoring routines that    routines that focus on                it is no longer relevant
                         resources, emphasize important           focus on requirements       requirements related to            Final Monitoring Report Checklist for reviewing a
                         requirements, and increase the           related to this priority.   this priority.                        report of an on-site visit (click here)
                         probability of improved results.                                                                        Team Leader Implementation Checklist (click
                                                                                                                                    here)
Focused monitoring       Focused monitoring is a visit that                                                                Refer to OSEP Verification/Focused Monitoring on the
(OSEP)                   occurs when OSEP has determined                                                                   SPP/APR Calendar: for Part B (click here); for Part C
                         an area of specific focus in which to                                                             (click here).
See also Verification    monitor within a State. At that time,
Visit (OSEP).            OSEP travels to the State and visits                                                              Materials include, but are not limited to:
                         school districts selected prior to the                                                                OSEP Verification/Focused Monitoring Manual
                         visit. Site selection is data driven                                                                       (coming soon)
                         and is intended to provide a picture                                                                  CrEAG complete
                         of what the issue looks like in the                                                                   CrEAG General Supervision
                         state. The OSEP monitoring team                                                                       CrEAG Data
                         reviews student files and has in-                                                                     CrEAG Fiscal
                         depth interviews with staff, building
                         supervisors, administrators,
                                                                                                                                                                                   11
                                                     Choosing a Common Language: Terms and Definitions Used for the SPP/APR
                        (Reviewed/revised by the RRCP Data Priority Team and the State Data Managers Feedback Group after the June 2008 Data Meeting)
                                                                            Revised August 2009
Term                                 Definition                    Part C Example                Part B Example                       SPP/APR References and Notes
                       providers, and others to determine
                       compliance/noncompliance and to
                       get to the root cause analysis of
                       issues examined during focused
                       monitoring.

                       The purpose of focused monitoring
                       may include:

                               Root cause analysis
                               Additional identification of
                                noncompliance at the local
                                level
                               A primary method to
                                deliver technical assistance
                               A method to document
                                improvement strategies
                                carried out at the State and
                                local level and specific
                                evidence of change

General supervision    A system of functions and                See ―Developing and          See ―Developing and         Developing and Implementing an Effective System of
                       management undertaken by the state       Implementing an              Implementing an             General Supervision: Part B, January 2007 (click here)
                       to ensure full implementation of the     Effective System             Effective System
                       requirements of federal law by the       of General Supervision:      of General Supervision:     Developing and Implementing an Effective System of
                       LEAs/EI programs. LEAs and LAs           Part C‖                      Part B‖                     General Supervision: Part C, April 2007 (click here)
                       might also use the term in the same
                       way to ensure full
                       compliance.
Identification of      Occurs on the date on which the          Noncompliance might          Noncompliance might be      Refer to SPP/APR Submission Tools on the SPP/APR
noncompliance          state provides written notification to   be identified through a      identified through a        Calendar: for Part B (click here); for Part C (click here).
                       the LEA or EI program of the             number of Part C Lead        number of SEA
Related term:          noncompliance. The one-year              Agency monitoring or         monitoring or data          Materials include, but are not limited to:
Finding.               correction timeline must be counted      data collection activities   collection activities as        OSEP Timely Correction Memo 09-02/Reporting
                       from the date the state notifies the     as well as through the       well as through the                  on Correction of Noncompliance (click here).
See also Correction    LEA or the EI program in writing of      dispute resolution           dispute resolution system
                                                                                                                                                                                   12
                                                   Choosing a Common Language: Terms and Definitions Used for the SPP/APR
                      (Reviewed/revised by the RRCP Data Priority Team and the State Data Managers Feedback Group after the June 2008 Data Meeting)
                                                                          Revised August 2009
Term                               Definition                      Part C Example                Part B Example                         SPP/APR References and Notes
of noncompliance &    the noncompliant policies,               system including             including complaints and              B15 Worksheet
Timely correction.    procedures, or practices.                complaints and due           due process hearings.                 C9 Worksheet
                      Notification of findings needs to        process hearings.                                                  Definitions of terms commonly used in
                      occur as soon as possible after the                                                                          monitoring (e.g., finding, correction of
                      state concludes that the LEA or EI                                                                           noncompliance, enforcement action), 8/23/07
                      program has noncompliance.                                                                                   (click here).

                      It should be noted that if the LEA or                                                               Also, for a more specific definition of a finding, refer to the
                      EI program immediately (i.e., before                                                                term in OSEP FAQ on Identification and Correction,
                      the State issues a finding) corrects                                                                9/3/08 (click here)
                      noncompliance and provides
                      documentation of such correction,
                      the State may choose not to make a
                      finding.
Improvement           A description of how the state will      Examples of                  Examples of                   Refer to SPP/APR Submission Tools on the SPP/APR
activities            improve performance for each             improvement activities       improvement activities        Calendar: for Part B (click here); for Part C (click here).
                      indicator, including activities,         for Part C might include     for Part B might include
                      timelines, and resources.                revisions in state           revisions in state statutes   Materials include, but are not limited to:
                                                               statutes or regulations,     or regulations,                   Part B Instruction Sheet
                                                               professional                 professional development          Part C Instruction Sheet
                                                               development initiatives      initiatives for LEAs or
                                                               for local programs or        more frequent onsite
                                                               more frequent onsite         monitoring.
                                                               monitoring.
Improvement plan      A plan that outlines the activities in   Collection of data for       Collection of data for        (Click here) to access the document Developing and
                      which the state or local program         Indicator C-4 revealed       Indicator B-8, revealed       Implementing an Effective System of General Supervision:
                      will engage to address areas             poor rates of families       poor rates of parents         Part B (NCSEAM), (January 2007); go to page 14.
Related term:         identified through monitoring            reporting that EI            reporting that the LEA
Corrective action     activities, data analysis, self-         services have helped         facilitated parent            Additional resource:
plan ( CAP)           assessment or other review process       them to know their           involvement. As a result,         Final CAP/IP Checklist (click here)
                      to improve performance.                  rights, effectively          the LEA developed an
                                                               communicate their            Improvement Plan to
                      Successful completion of                 child’s needs and help       address improvement in
                      improvement activities should lead       their child develop and      the area of parent
                      to significant progress towards          learn. As a result, the EI   involvement.
                      reaching established targets on          program developed an

                                                                                                                                                                                      13
                                                  Choosing a Common Language: Terms and Definitions Used for the SPP/APR
                     (Reviewed/revised by the RRCP Data Priority Team and the State Data Managers Feedback Group after the June 2008 Data Meeting)
                                                                         Revised August 2009
Term                              Definition                    Part C Example            Part B Example                        SPP/APR References and Notes
                    performance indicators. This is         Improvement Plan to
                    identified through data analysis,       address improvement
                    documentation of evidence of            for the C-4 Family
                    change, and other methods.              Outcomes indicator.
Indicator           A statement used to help quantify       Indicator C-1: Percent    Indicator B-8: Percent of    Refer to SPP/APR Submission Tools on the SPP/APR
                    and/or qualify a monitoring priority.   of infants and toddlers   parents with a child         Calendar: for Part B (click here); for Part C (click here).
                    Indicators are determined by the        with IFSPs who receive    receiving special
                    Secretary and focus on improving        the early intervention    education services who       Materials include, but are not limited to:
                    educational results and functional      services on their IFSPs   report that schools              Part B Instruction Sheet
                    outcomes for infants and toddlers,      in a timely manner. (20   facilitated parent               Part C Instruction Sheet
                    children, and youth with disabilities   U.S.C. 1416(a)(3)(A)      involvement as a means
                    and their families as well as           and 1442)                 of improving services
                    compliance with IDEA.                                             and results for children
                                                                                      with disabilities. (20
                                                                                      U.S.C. 1416(a)(3)(A))
Item nonresponse    The noncompletion of specific           If in the Part C Family   If in the Part B Parent      Garrison-Mogren (2007). Post-School Outcomes: Response
                    survey questions by a respondent. If    Outcomes survey, 10%      Involvement survey, 10%      Rates and Nonresponse Bias, National Post School
                    a completed survey is missing           of the respondents only   of the respondents only      Outcomes Center
                    responses to critical questions, it     completed half of the     completed half of the
                    may be advisable to treat the entire    survey items, that 10%    survey items, that 10% of
                    survey as a nonresponse.                of non-completers         non-completers might be
                                                            might be considered a     considered a
                                                            nonresponse.              nonresponse.
Measurable and      The desired level of performance to     For Indicator C-2,        For Indicator B-4, targets   Refer to SPP/APR Submission Tools on the SPP/APR
rigorous target     be reached for the specified FFY for    targets of 80%, 85%,      of 80%, 85%, 90%, 95%        Calendar: for Part B (click here); for Part C (click here).
                    each SPP Indicator.                     90%, 95% and 100%         and 100% would show a
                                                            would show a              progression of               Materials include, but are not limited to:
                    For compliance indicators, the          progression of            measurable and rigorous          Part B Instruction Sheet
                    targets must be 100% or 0% for B-9      measurable and            targets.                         Part C Instruction Sheet
                    and 10.                                 rigorous targets.
                    Generally, measurable and rigorous
                    targets must be higher than baseline
                    for a given results indicator by the
                    final year of the SPP. This isn’t
                    necessarily true for mediation and
                    resolution meeting targets when the

                                                                                                                                                                             14
                                                Choosing a Common Language: Terms and Definitions Used for the SPP/APR
                   (Reviewed/revised by the RRCP Data Priority Team and the State Data Managers Feedback Group after the June 2008 Data Meeting)
                                                                       Revised August 2009
Term                               Definition                   Part C Example               Part B Example                        SPP/APR References and Notes
                     State establishes a range target. The
                     baseline can be higher than the
                     lowest part of the range.
Measurement          Specific steps, calculations and/or     The measurement for         The measurement for B-       Refer to SPP/APR Submission Tools on the SPP/APR
                     formulas determined by the              C-1 is: Percent = [(# of    13 is:                       Calendar: for Part B (click here); for Part C (click here).
                     Secretary and in designated cases by    infants and toddlers        Percent = [(# of youth
                     the SEA or LA, used to quantify or      with IFSPs who receive      with disabilities aged 16    Materials include, but are not limited to:
                     qualify given indicators.               the early intervention      and above with an IEP            Part B Indicator Measurement Table
                                                             services on their IFSPs     that includes coordinated,       Part B Instruction Sheet
                                                             in a timely manner)         measurable, annual IEP           Part C Indicator Measurement Table
                                                             divided by the (total #     goals and transition             Part C Instruction Sheet
                                                             of infants and toddlers     services that will
                                                             with IFSPs)] times 100.     reasonably enable the
                                                                                         student to meet the post-
                                                                                         secondary goals) divided
                                                                                         by the (# of youth with an
                                                                                         IEP age 16 and above)]
                                                                                         times 100.
Minimum cell size    Minimum cell size is the lowest         A Lead Agency (LA)          For determining
                     allowable number in a cell. There       sets its minimum cell       disproportionate
Related term:        are two reasons for requiring a         size at 5 for public        representation for
Cell size            minimum number of students or           reporting of the number     Indicators B9 and B10,
                     incidents in a cell: (1) to protect     of children in the local    using a risk ratio may
                     confidentiality in reporting to the     Part C programs by          require a minimum cell
                     public when small numbers in            race/ethnicity.             size of 10 based on the
                     certain cells could identify                                        statistical properties of
                     individual students; and (2) to                                     the risk ratio.
                     ensure confidence in the
                     results/findings when using a
                     particular analytic method.
Monitoring           Activities or actions conducted to      Examples of monitoring      Examples of monitoring       Definitions of terms commonly used in monitoring (e.g.,
                     determine the functioning of a          activities include onsite   activities include onsite    finding, correction of noncompliance, enforcement action),
                     program or service compared to          EI program monitoring,      LEA monitoring, state        8/23/07 (click here)
                     what is required by a regulation or     state level data review,    level data review, desk
                     requirement for the purpose of          desk audits, self-          audits, self-assessment,     (Click here) to access the document Developing and
                     accountability.                         assessment, etc.            etc.                         Implementing an Effective System of General Supervision:

                                                                                                                                                                                15
                                                 Choosing a Common Language: Terms and Definitions Used for the SPP/APR
                    (Reviewed/revised by the RRCP Data Priority Team and the State Data Managers Feedback Group after the June 2008 Data Meeting)
                                                                        Revised August 2009
Term                                Definition                     Part C Example            Part B Example                    SPP/APR References and Notes
                                                                                                                    Part B, NCSEAM, (January 2007); go to page 11.
                       Integrated monitoring activities
                       are effective monitoring strategies
                       are integrated across all components
                       of the general supervision system.
                       Multiple data sources and methods
                       are used to monitor LEAs and EI
                       programs. Selected monitoring
                       activities ensure continuous
                       examination of performance for
                       compliance and results. This
                       includes onsite and off-site
                       monitoring activities. Monitoring
                       protocols should focus on specific
                       priority areas selected based on state
                       performance.
Monitoring priority    A prioritized area in which state and    Part C Monitoring        Part B Monitoring          Refer to SPP/APR Submission Tools on the SPP/APR
                       LEA or EI program performance is         Priorities include:      Priorities include:        Calendar: for Part B (click here); for Part C (click here).
                       measured. Monitoring priorities are
                       determined by the Secretary.             Early Intervention       FAPE in the LRE            Materials include, but are not limited to:
                                                                Services in Natural                                     Part B Instruction Sheet
                                                                Environments             Disproportionality             Part C Instruction Sheet

                                                                Effective General        Effective General
                                                                Supervision              Supervision
                                                                 Child Find              Child Find
                                                                 Transition              Effective Transition
                                                                 General                 General Supervision
                                                                    Supervision

Noncompliance          A violation of an IDEA                   For Indicator C-7        For Indicator B-13
                       requirement.                             (Timeliness of IFSP),    (Secondary Transition
                                                                failure to develop the   with IEP Goals), failure
                                                                IFSP within the          to develop an IEP for a
                                                                required 45 day          student 16 or older with
                                                                timeline.                measurable, annual IEP

                                                                                                                                                                              16
                                                   Choosing a Common Language: Terms and Definitions Used for the SPP/APR
                      (Reviewed/revised by the RRCP Data Priority Team and the State Data Managers Feedback Group after the June 2008 Data Meeting)
                                                                          Revised August 2009
 Term                               Definition                    Part C Example                Part B Example                      SPP/APR References and Notes
                                                                                           goals and transition
                                                                                           services.
 Non-response bias     Exists when the respondents to a        For Indicator C-4           For Indicator B-8 (Parent   Garrison-Mogren (2007). Post-School Outcomes: Response
                       survey are different from those who     (Family Outcomes), if       Involvement), if the        Rates and Nonresponse Bias, National Post School
Related term:          did not respond. That is, the survey    the percent of parents of   percent of parents of       Outcomes Center
Representativeness.    respondents are not representative      children on IFSPs was       children on IEPs was
                       of the population group.                60% White, 20%              60% White, 20% African
                                                               African American, and       American, and 20%
                                                               20% Hispanic but the        Hispanic but the percent
                                                               percent of total            of total respondents was
                                                               respondents was 80%         80% White, 10% African
                                                               White, 10% African          American, and 10%
                                                               American, and 10%           Hispanic, it would not be
                                                               Hispanic, it would not      appropriate to generalize
                                                               be appropriate to           survey results to the
                                                               generalize survey           entire target population
                                                               results to the entire       of parents. The
                                                               target population of        respondents to the survey
                                                               parents. The                were represented in
                                                               respondents to the          proportions that were
                                                               survey were represented     different from the entire
                                                               in proportions that were    target population of
                                                               different from the entire   parents.
                                                               target population of
                                                               parents.
 Passed edit check     618 Data Tables submitted to OSEP       N/A                         N/A                         Refer to https://www.ideadata.org/TAMaterial.asp
                       do not have missing cells or internal                                                           regarding Part B and Part C Edits.
                       inconsistencies.
                                                                                                                       Also, refer to SPP/APR Submission Tools on the SPP/APR
                                                                                                                       Calendar: for Part B (click here); for Part C (click here).

                                                                                                                       Materials include, but are not limited to:
                                                                                                                           B20 Rubric
                                                                                                                           C14 Rubric

 Performance data      In the APR, the state’s actual target   For Indicator C-5           For Indicator B-14 (Post-

                                                                                                                                                                               17
                                                   Choosing a Common Language: Terms and Definitions Used for the SPP/APR
                      (Reviewed/revised by the RRCP Data Priority Team and the State Data Managers Feedback Group after the June 2008 Data Meeting)
                                                                          Revised August 2009
Term                       Definition                     Part C Example             Part B Example                       SPP/APR References and Notes
              data reported for each indicator.       (Child Find, Ages Birth   School Outcomes), the
                                                      to One), the state’s      state’s actual target
                                                      actual target             data/performance data
                                                      data/performance data     reported in the APR were
                                                      reported in the APR       86%.
                                                      were 1.5%.
Policies      Policy is defined by a legislative or
              organizational requirement (the
              What). It requires approval from a
              governing board; infers some
              monitoring for compliance; often
              uses legal terms; and addresses
              federal and/or statutory
              requirements.
Procedures    Procedure defines the way in which
              the policy is implemented (the
              How). It may be flexible; may be
              dictated by policies to guide
               specific procedural steps (e.g., due
              process, etc.); and may be a laymen
              interpretation of language.
Procedural    Adherence to specific procedural        For Indicator C-7         For Indicator B-13
compliance    requirements in IDEA 2004 and           (Timeliness of IFSP),     (Secondary Transition
              IDEA Regulations.                       demonstration that the    with IEP Goals),
                                                      IFSP was developed        demonstration that an
                                                      within the required 45    IEP for a student 16 or
                                                      day timeline.             older included
                                                                                measurable, annual IEP
                                                                                goals and transition
                                                                                services.
Progress      Showing positive change toward the      For Indicator C-1         For Indicator B-1            Refer to SPP/APR Submission Tools on the SPP/APR
              target. In the APR, this section        (Timely Service           (Graduation), the            Calendar: for Part B (click here); for Part C (click here).
              requires a comparison of the Actual     Delivery), the            established target was set
              Target Data to the target for the       compliance rate in FFY    at 60%. In FFY 2004 the      Materials include, but are not limited to:
              FFY, to baseline, and to the            2004 was 75% and          baseline data was 50%.           Part B Instruction Sheet
              previous year’s data, showing an        improved to 85% in        In FFY 2005, the actual          Part C Instruction Sheet

                                                                                                                                                                       18
                                          Choosing a Common Language: Terms and Definitions Used for the SPP/APR
             (Reviewed/revised by the RRCP Data Priority Team and the State Data Managers Feedback Group after the June 2008 Data Meeting)
                                                                 Revised August 2009
Term                              Definition                     Part C Example              Part B Example                        SPP/APR References and Notes
                    analysis of the data, a description of   FFY 2005, showing          target data was 52%.
                    the improvement activities               progress toward the        This demonstrates a
                    implemented during the FFY and           target of 100%.            gradual improvement
                    progress made toward the target.                                    (progress) toward the
                                                                                        established target of 60%.
Public reporting    The state must ensure public             Note: No specific,         Supplemental regulations     Refer to OSEP Determination Documents on the SPP/APR
                    reporting of every LEA/EIS               written language           (34 CFR Section              Calendar: for Part B (click here); for Part C (click here).
                    program against each State target        pertaining to a required   300.602) states that ―as
                    over the course of the SPP.              or suggested timeline      soon as practicable but no   Materials include, but are not limited to:
                                                             for reporting to the       later than 120 days              Reporting to Public
                    Citation: Section 616(b)(2)(C)(ii) of    public is noted in the     following the State’s            Part B Indicator Overview
                    IDEA 2004                                requirements.              submission of its APR to         Part C Indicator Overview
                                                                                        the Secretary‖.
                                                                                                                     Note: The right column of the Part B and Part C Indicator
                                                                                                                     Overview highlights indicators that must be reported to the public.
Random sample       This term refers to a method of          The Lead Agency            The SEA monitoring
                    selecting a sample where by every        monitoring team uses a     team uses a table of
                    element (e.g., child or family) in the   table of random            random numbers to select
                    population has an equal probability      numbers to select 10       10 Part B records to
                    of inclusion in the sample.              Part C records to review   review during an onsite
                                                             during an onsite visit.    visit.
Related             The list of the Monitoring Priorities    Although Indicator C-2     Although Indicator B-11      Refer to SPP/APR Submission Tools on the SPP/APR
requirements        and Indicators and the requirements      (Settings) addresses the   (Child Find) addresses       Calendar: for Part B (click here); for Part C (click here).
                    from the statutes and regulations        provision of services to   timelines for conducting
                    that are related to each Priority and    children in the home or    evaluations [20 U.S.C.       Materials include, but are not limited to:
                    Indicator. The purpose of the            in programs for            1416(a)(3)(B)], there are        Part B SPP/APR Related Requirements
                    Related Requirements document is         typically developing       several ―related                 Part B Instruction Sheet
                    to: (1) inform states of the statutory   peers, a ―related          requirements‖ that               Part C SPP/APR Related Requirements
                    and/or regulatory requirements           requirement‖ is that the   pertain to this indicator.       Part C Instruction Sheet
                    related to each indicator that will be   IFSP shall contain a       For example, the
                    reviewed by OSEP as part of              statement of the natural   requirement that ―child
                    Focused Monitoring. That is, if          environments in which      find‖ shall apply to
                    OSEP determines that it will do          early intervention         children with disabilities
                    Focused Monitoring in a state based      services will              in the state who are
                    on performance or compliance with        appropriately be           enrolled in private,
                    a specific indicator, OSEP will          provided, including a      including religious,

                                                                                                                                                                                    19
                                                Choosing a Common Language: Terms and Definitions Used for the SPP/APR
                   (Reviewed/revised by the RRCP Data Priority Team and the State Data Managers Feedback Group after the June 2008 Data Meeting)
                                                                       Revised August 2009
Term                                 Definition                     Part C Example              Part B Example                       SPP/APR References and Notes
                       review the Related Requirements          justification of the       elementary schools and
                       for that indicator as part of the        extent, if any, to which   secondary schools is a
                       Focused Monitoring; and (2)              the services will not be   ―related requirement‖ for
                       provide States with a resource that      provided in a natural      B-11. [20 U.S.C.
                       identifies IDEA regulatory               environment. [20           1412(a)(10)(A)(ii); 34
                       requirements that are closely            U.S.C. 1436(d)(5); 34      CFR §300.131]
                       aligned with the specific SPP            CFR §303.344(d)(ii)]
                       indicators OSEP encourages states
                       to examine their General
                       Supervision systems to determine
                       how they address these Related
                       Requirements.
Relative risk ratio    A relative risk ratio is the same as a
                       risk ratio.
See Risk ratio.
Reliability            Reliability refers to consistency of     For Indicator C-2          For Indicator B-5 (LRE       Indicators B20 & C14 Data Accuracy: Critical Elements
                       measurement. To what extent can          (Settings), services in    Placement), if local LEAs    for Review of SPPs, November 2006 (click here)
                       we be confident that the same            the natural                do not use a consistent
                       instrument or procedure, applied to      environment, if local EI   definition of the various    Also, refer to the definitions located at the following URLs
                       the same population, would yield         programs do not record     placement categories, the    (retrieved on 11/12/2008):
                       the same result if the measurement       placement data in a        data reported to the state    http://www.socialresearchmethods.net/kb/reliable.php
                       were repeated on two occasions           manner that is             would lack reliability.       http://www.encyclopedia.com/doc/1O88-
                       very close in time, or if the            consistent across                                            reliability.html
                       measurement were done by different       programs, the data
                       individuals? Since measurement is        reported to the state
                       never perfect, it is important to        would lack reliability.
                       quantify how much consistency
                       (reliability) or inconsistency (error)
                       there is in any given measurement.
                       Statistics used to express
                       measurement reliability range from
                       .00 (no consistency) to 1.00 (perfect
                       consistency). If the reliability is
                       high, for example, .90 or above, the
                       measurement has little error and is
                       highly reliable. Error is usually

                                                                                                                                                                                 20
                                                   Choosing a Common Language: Terms and Definitions Used for the SPP/APR
                      (Reviewed/revised by the RRCP Data Priority Team and the State Data Managers Feedback Group after the June 2008 Data Meeting)
                                                                          Revised August 2009
 Term                               Definition                      Part C Example               Part B Example                         SPP/APR References and Notes
                       reported as a confidence interval,
                       standard error of measurement, or
                       margin of error. If the error is small,
                       for example, +/- 1% on a
                       measurement reported as a
                       percentage, this is also an indication
                       that the measurement has little error
                       and is highly reliable.
 Representativeness    Is demonstrated when a subset, or         For Indicator C-4           For Indicator B-8 (Parent     Garrison-Mogren (2007). Post-School Outcomes: Response
                       sample, of individuals from a larger      (Family Outcomes), if       Involvement), if the          Rates and Nonresponse Bias, National Post School
Related term:          group, or population, mirrors the         the percent of parents of   percent of parents of         Outcomes Center
Non-response bias.     larger group on important                 children on IFSPs was       children on IEPs was
                       demographic characteristics.              60% White, 20%              60% White, 20% African        See the NPSO Sampling paper Post-School Outcomes for
                       Representativeness, rather than the       African American, and       American, and 20%             Youth with Disabilities—Establishing a Representative
                       attainment of a specific number of        20% Hispanic but the        Hispanic but the percent      Sample of Your State to Address Indicator #14 at
                       survey responses, is the objective        percent of total            of total respondents to the   http://www.psocenter.org.
                                                                 respondents to the          parent survey was 80%
                       when collecting survey data.
                                                                 parent survey was 80%       White, 10% African
                                                                 White, 10% African          American, and 10%
                                                                 American, and 10%           Hispanic, the
                                                                 Hispanic, the               subset/sample of
                                                                 subset/sample of            respondents would not
                                                                 respondents would not       reflect the larger group in
                                                                 reflect the larger group    terms of racial or ethnic
                                                                 in terms of racial or       representation.
                                                                 ethnic representation.
 Representative        This term refers to a population          The sample of families      The sample of families        Refer to SPP/APR Submission Tools on the SPP/APR
 sample                subgroup that resembles the               selected to receive a       selected to receive a         Calendar: for Part B (click here); for Part C (click here).
                       population on important                   survey for Indicator C4     survey for Indicator B8
Related term:          characteristics.                          resembles all families in   resembles all families in     Materials include, but are not limited to:
Sampling.                                                        the Part C program in       the Part B program in             Part B Instruction Sheet, General Instructions, p. 2
                                                                 regard to the child’s       regard to the child’s             Part C Instruction Sheet, General Instructions, p. 2
                                                                 race/ethnicity, child’s     race/ethnicity, child’s
                                                                 disability, and child’s     disability, and child’s
                                                                 gender.                     gender.
 Responded to data     The state provided written                N/A                         N/A                           Refer to SPP/APR Submission Tools on the SPP/APR

                                                                                                                                                                                     21
                                                   Choosing a Common Language: Terms and Definitions Used for the SPP/APR
                      (Reviewed/revised by the RRCP Data Priority Team and the State Data Managers Feedback Group after the June 2008 Data Meeting)
                                                                          Revised August 2009
Term                               Definition                   Part C Example                Part B Example                     SPP/APR References and Notes
note request          explanation in response to data note                                                           Calendar: for Part B (click here); for Part C (click here).
                      requests.
                                                                                                                     Materials include, but are not limited to:
                      Note: For more information, contact                                                                B20 Rubric
                      the Data Accountability Center                                                                     C14 Rubric
                      (DAC).
Response pool         This term refers to the group of       The LA sent out 1000       The SEA sent out 2500        A similar term, respondent families, is used in the Part B
                      individuals (or entity, such as a      surveys to families to     surveys to families to       and Part C Indicator Measurement Tables, Data Source and
                      school) that returns a survey.         collect data for           collect data for Indicator   Measurement columns for B8 and C4, respectively.
                      Synonyms include respondent            Indicator C4 and 250       B8 and 600 families
                      group, response group, respondent      families returned a        return a completed           Refer to SPP/APR Submission Tools on the SPP/APR
                      pool, and respondents.                 completed survey. This     survey. This group of 600    Calendar: for Part B (click here); for Part C (click here).
                                                             group of 250 families is   families is the response
                                                             the response pool.         pool.                        Materials include, but are not limited to:
                                                                                                                          Part B Indicator Measurement Table
                                                                                                                          Part C Indicator Measurement Table
Response rate         The ratio of the number of             For Indicator C-4          For Indicator B-8 (Parent    Garrison-Mogren (2007). Post-School Outcomes: Response
                      completed surveys to the total         (Family Outcomes), if      Involvement), if the         Rates and Nonresponse Bias, National Post School
                      number of surveys intended to be       the parent survey was      parent survey was sent to    Outcomes Center
                      completed.                             sent to 1000 parents but   1000 parents but only
                                                             only 500 responded, the    500 responded, the
                                                             response rate would be     response rate would be
                                                             50%.                       50%.
Results indicators    In the SPP/APR, those indicators       Results Indicators for     Results Indicators for
                      that focus on system and student       Part C include: C-2, C-    Part B include:
                      results and child and family           3, C-4, C-5, C-6, C-12,    B-1, B-2, B-3, B-4a, B-5,
                      outcomes.                              C-13.                      B-6, B-7, B-8, B-14, B-
                                                                                        18, B-19.
                      Related terms that are often used
                      interchangeably with results
                      indicators are outcome indicators
                      and performance indicators.
Revisions with        In the SPP/APR, a description of       N/A                        N/A                          Part B Instruction Sheet for SPP/APR FFY 2007 (click
justification         any revised targets, activities,                                                               here) - suggest deleting link and leaving generally, to state
                      timelines or resources. This                                                                   ―Part B Instruction Sheet for SPP/APR‖
                      information should include the

                                                                                                                                                                               22
                                                  Choosing a Common Language: Terms and Definitions Used for the SPP/APR
                     (Reviewed/revised by the RRCP Data Priority Team and the State Data Managers Feedback Group after the June 2008 Data Meeting)
                                                                         Revised August 2009
Term                                  Definition                    Part C Example              Part B Example                     SPP/APR References and Notes
                       state's revisions to the SPP and                                                               Part C Instruction Sheet for SPP/APR FFY 2007 (click
                       justification for the revisions.                                                               here) - suggest deleting link and leaving generally, to state
                       Revisions to targets, activities,                                                              ―Part C Instruction Sheet for SPP/APR‖
                       timelines or resources do not relieve
                       the state of its responsibility to
                       provide "Actual Target Data" for the
                       given year. When making revisions
                       to the SPP targets, the State must
                       describe the steps taken to obtain
                       ―broad input‖ from stakeholders in
                       the resetting of those targets.
Risk ratio             This ratio provides a means of            N/A                        For Indicators B9 & B10   Methods for Assessing Racial/Ethnic Disproportionality in
                       comparing risk. When applied to a                                    (Disproportionate         Special Education: A Technical Assistance Guide, DAC,
Related term:          disability category, the risk ratio                                  Representation), see      (July 2007) (click here)
Modified risk ratio    answers the question, ―What is a                                     examples in TA
calculation.           specific racial/ethnic group’s risk of                               document referenced in
                       receiving special education and                                      next column.
                       related services for a particular
                       disability as compared to the risk for
                       all other students?‖

                       Modified risk ratio calculations are
                       used to address potential problems
                       that SEAs may have when applying
                       the risk ratio to analysis of district-
                       level data to determine racial/ethnic
                       disproportionate representation,
                       there are two proposed
                       modifications—(1) weighted risk
                       ratio and (2) alternate risk ratio. The
                       TA document referenced in the last
                       column of this row explains these
                       modifications in detail.
Root cause analysis    The process of systematically             By disaggregating child    For Indicator B-5 (LRE    Max Ammerman (1998). The Root Cause Analysis
                       detecting and analyzing the possible      find data for Indicator    Placement), by            Handbook. Portland, OR: Productivity, Inc.
                       causes of a problem.                      C-6, Preschool Settings,   disaggregating data on

                                                                                                                                                                                 23
                                                   Choosing a Common Language: Terms and Definitions Used for the SPP/APR
                      (Reviewed/revised by the RRCP Data Priority Team and the State Data Managers Feedback Group after the June 2008 Data Meeting)
                                                                          Revised August 2009
 Term                          Definition                     Part C Example               Part B Example                        SPP/APR References and Notes
 Related term:                                            for a single local EI       placement status for
 Drill down.                                              program by                  schoolage children within
                                                          race/ethnicity and then     an LEA by disability
                                                          exploring what types of     category, it would be
                                                          outreach had been           possible to determine if
                                                          provided to particular      particular disability
                                                          groups of families, it      groups were over-
                                                          would be possible to        represented in more
                                                          determine if particular     restrictive placements.
                                                          groups were under-          Further analysis would
                                                          represented in child find   help determine why
                                                          activities.                 particular categories of
                                                                                      disability were over-
                                                                                      represented in more
                                                                                      restrictive placements.
 Sampling         Collecting data on a subset of the      For Indicator C-4           For Indicator B-8 (Parent    Refer to SPP/APR Submission Tools on the SPP/APR
                  population, selected to represent the   (Family Outcomes), the      Involvement), the SEA        Calendar: for Part B (click here); for Part C (click here).
Related term:     total population.                       Part C Lead Agency          may choose to sample
Representative                                            may choose to sample        from the total population    Materials include, but are not limited to:
sample.                                                   from the total              of parents of children           Part B Instruction Sheet, General Instructions, p. 2
                                                          population of parents of    with IEPs rather than            Part C Instruction Sheet, General Instructions, p. 2
                                                          children with IFSPs         send the survey to the
                                                          rather than send the        entire population.           Part B/C Sampling Plan Template (click here)
                                                          survey to the entire
                                                          population.                                              Note: When sampling is used, a description of the sampling
                                                                                                                   methodology outlining how the design will yield valid & reliable
                                                                                                                   estimates; the written sampling plan must be submitted and
                                                                                                                   approved by OSEP.
 Significant      In the SPP/APR, the definition of       N/A                         For Indicator B-4A           Refer to SPP/APR Submission Tools on the SPP/APR
 discrepancy      ―significant discrepancy‖ is left to                                (Suspension/Expulsion),      Calendar: for Part B (click here); for Part C (click here).
                  state discretion for Indicator B-4.                                 discrepancy can be
                                                                                      computed by either           Materials include, but are not limited to:
                                                                                      comparing rates for              Part B Indicator Measurement Table
                                                                                      children with disabilities       Part C Indicator Measurement Table
                                                                                      to rates for nondisabled
                                                                                      within a district or by
                                                                                      comparing among LEAs
                                                                                                                                                                                 24
                                              Choosing a Common Language: Terms and Definitions Used for the SPP/APR
                 (Reviewed/revised by the RRCP Data Priority Team and the State Data Managers Feedback Group after the June 2008 Data Meeting)
                                                                     Revised August 2009
Term                               Definition                     Part C Example             Part B Example                        SPP/APR References and Notes
                                                                                        for children with
                                                                                        disabilities in the state.
Significant           Each State has the discretion to         N/A                      N/A                          OSEP Policy Memo (08-09)/CEIS (click here)
disproportionality    define what constitutes significant                                                            Note: When the SEA identifies LEAs with significant
                      disproportionality for the LEAs in                                                             disproportionality in one or more of these areas based on the
                      the State and for the State in                                                                 collection and examination of their data, states must: 1) provide
                                                                                                                     for the review (and, if appropriate) revision of policies,
                      general. However, a State’s                                                                    procedures, and practices; 2) require the LEA to reserve the
                      definition of significant                                                                      maximum amount of funds to be used for early intervening
                      disproportionality needs to be based                                                           services; and 3) require the LEA to publicly report on the revision
                      on an analysis of numerical                                                                    of policies, procedures, and practices.
                      information.

                      States have a separate obligation,
                      under 20 U.S.C. 1418(d) and 34
                      CFR §300.646, to collect and
                      examine data to determine whether
                      significant disproportionality based
                      on race or ethnicity is occurring in
                      the state and LEAs of the state with
                      respect to the identification of
                      children as children with
                      disabilities, including identification
                      as children with particular
                      impairments; the placement of
                      children in particular educational
                      settings; and the incidence, duration,
                      and type of disciplinary actions,
                      including suspensions and
                      expulsions. States must make this
                      determination on an annual basis.
Slippage              Showing negative change related to       For Indicator C-1        For Indicator B-1, the       Refer to SPP/APR Submission Tools on the SPP/APR
                      the target. Differences may be           (Timely Service          graduation rate decreased    Calendar: for Part B (click here); for Part C (click here).
                      explained by referencing an analysis     Delivery), the           from 50% in 2004-05 to
                      of the measures and related              compliance rate in FFY   49% in 2005-06.              Materials include, but are not limited to:
                      statistics.                              2004 was 75% and                                          Part B Instruction Sheet
                                                               slipped to 70% in FFY                                     Part C Instruction Sheet

                                                                                                                                                                                     25
                                                  Choosing a Common Language: Terms and Definitions Used for the SPP/APR
                     (Reviewed/revised by the RRCP Data Priority Team and the State Data Managers Feedback Group after the June 2008 Data Meeting)
                                                                         Revised August 2009
Term                              Definition                    Part C Example                Part B Example                      SPP/APR References and Notes
                                                             2005.
                                                                                                                    Note: The APR should include a description of how the state
                                                                                                                    plans to address the slippage through adjustments or
                                                                                                                    improvements made in state programs, policies, or practices
                                                                                                                    including an explanation of performance data, if needed.
State fiscal year    The state fiscal year on which data     N/A                        N/A
(SFY)                are being reported, typically July 1-
                     June 30. State fiscal years are often
                     forward numbered, e.g. SFY 2006 is
                     2005-06. In contrast, federal fiscal
                     years are beginning numbered, e.g.
                     FFY 2006 is 2006-07.

Subsequent           If an LEA or EIS program did not        The state should notify    The state should notify     Refer to SPP/APR Submission Tools on the SPP/APR
correction           correct identified noncompliance in     the Early Intervention     the LEA in writing that     Calendar: for Part B (click here); for Part C (click here).
                     a timely manner (within one year        (EI) program in writing    the noncompliance is
                     from identification), the State must    that the noncompliance     corrected.                  Materials include, but are not limited to:
                     report on whether the                   is corrected.                                              OSEP Timely Correction Memo 09-02/Reporting
                     noncompliance was subsequently                                     For the purposes of the              on Correction of Noncompliance (click here).
                     corrected. Further, if an LEA or        For the purposes of the    SPP/APR reporting,              B15 Worksheet
                     EIS program is not yet correctly        SPP/APR reporting,         timely correction occurs        C9 Worksheet
                     implementing the                        timely correction occurs   when noncompliance is           Definitions of terms commonly used in
                     statutory/regulatory requirement(s),    when noncompliance is      corrected and verified as            monitoring (e.g., finding, correction of
                     the State must explain what the         corrected and verified     soon as possible but no              noncompliance, enforcement action), 8/23/07
                     State has done to identify the          as soon as possible but    later than one year from             (click here).
                     cause(s) of continuing                  no later than one year     the notification of
                     noncompliance, and what the State       from the notification of   noncompliance.              Also, for a more specific definition of a finding, refer to the
                     is doing about the continued lack of    noncompliance.                                         term in OSEP FAQ on Identification and Correction,
                     compliance including, as                                           States should also report   9/3/08 (click here)
                     appropriate, enforcement actions        States should also         whether the LEA
                     taken against any LEA or EIS            report whether the EIS     subsequently corrected
                     program that continues to show          subsequently corrected     the noncompliance (i.e.,
                     noncompliance.                          the noncompliance (i.e.,   beyond the one year
                                                             beyond the one year        timeline).
                                                             timeline).
Target               The desired level of the indicator      For Indicator C-2          For Indicator B-1           Refer to SPP/APR Submission Tools on the SPP/APR
                     measure to be reached within a time     (Settings), 90% of         (Graduation), 70% of        Calendar: for Part B (click here); for Part C (click here).
                                                                                                                                                                                  26
                                                 Choosing a Common Language: Terms and Definitions Used for the SPP/APR
                    (Reviewed/revised by the RRCP Data Priority Team and the State Data Managers Feedback Group after the June 2008 Data Meeting)
                                                                        Revised August 2009
Term                              Definition                    Part C Example               Part B Example                       SPP/APR References and Notes
                     period. A target may be long or        infants and toddlers        children with disabilities
                     short term.                            with disabilities will      will graduate with a         Materials include, but are not limited to:
                                                            receive early               regular diploma by 2010.         Part B Instruction Sheet
                                                            intervention services in                                     Part C Instruction Sheet
                                                            natural environments.

Target group or      This term typically refers to the      A target group for C4       A target group for B14       Note: This term is not referenced in the SPP/APR
target population    group of students or parents from      (Family Outcomes)           (Post-School Outcomes)       Information Collections 1820-0624, 1820-0677, and 1820-
                     which the state wants to obtain data   may be identified by the    may be the youth who         0659.
                     for a particular indicator.            state as all parents that   had IEPs and are no
                                                            currently have children     longer in secondary
                                                            in the Part C program       school.
                                                            and have been enrolled
                                                            for at least 6 months.
Timely data          All data for the APR are submitted     N/A                         N/A                          Refer to SPP/APR Submission Tools on the SPP/APR
submission           on or before the due dates provided                                                             Calendar: for Part B (click here); for Part C (click here).
                     by OSEP. Data for tables for 618
                     are submitted on or before each                                                                 Materials include, but are not limited to:
                     tables’ due date. No extensions.                                                                     B20 Rubric
                                                                                                                             C14 Rubric
Timely correction    When noncompliance is corrected        For Indicator C-1           For Indicator B-11 (Child    Refer to SPP/APR Submission Tools on the SPP/APR
                     and verified as soon as possible but   (Timely Service             Find), if the SEA made       Calendar: for Part B (click here); for Part C (click here).
Related terms:       no later than one year from the        Delivery), if the LA        findings of
Identification of    written identification of              made findings of            noncompliance in 10          Materials include, but are not limited to:
noncompliance &      noncompliance.                         noncompliance in 10 EI      LEAs, those districts            Part B Indicator Measurement Table
Correction of                                               programs, those             would need to ―timely            B20 Rubric
noncompliance                                               programs would need to      correct‖ noncompliance           Part C Indicator Measurement Table
                                                            ―timely correct‖            within one year from the         C14 Rubric
See also Finding.                                           noncompliance within        SEA notified the LEA in          OSEP Timely Correction Memo 09-02/Reporting
                                                            one year from the date      writing of the                        on Correction of Noncompliance (click here).
                                                            that the LA notified the    noncompliance.                   Definitions of terms commonly used in
                                                            EI program in writing,                                            monitoring (e.g., finding, correction of
                                                            of the noncompliance.                                             noncompliance, enforcement action), 8/23/07
                                                                                                                              (click here).

                                                                                                                     Also, for a more specific definition of a finding, refer to the
                                                                                                                                                                                 27
                                                 Choosing a Common Language: Terms and Definitions Used for the SPP/APR
                    (Reviewed/revised by the RRCP Data Priority Team and the State Data Managers Feedback Group after the June 2008 Data Meeting)
                                                                        Revised August 2009
Term                          Definition                     Part C Example             Part B Example                         SPP/APR References and Notes
                                                                                                                 term in OSEP FAQ on Identification and Correction,
                                                                                                                 9/3/08 (click here)

                                                                                                                 Note: Requirement—Indicator B-20 and C-14: State reported data
                                                                                                                 (618 and State Performance Plan and Annual Performance
                                                                                                                 Report) are timely and accurate. (20 U.S.C. 1416(a)(3)(B) and
                                                                                                                 1442).
Trend            A summary of past performance            For Indicator C-6         For Indicator B-1            From OSEP APR Notes, ―Performance data, both baseline
                 over time that may be used to            (Child Find, Ages Birth   (Graduation), the            and trend, that the state used to measure/assess progress,
                 display progress toward the target,      to Three), the            percentage of students       maintenance and/or compliance.‖
                 maintenance and/or compliance.           percentage of children    with disabilities
                 Trend data are at least three years of   identified for Part C,    graduating from high
                 data that show a line of general         ages birth to three for   school with a regular
                 direction or movement.                   1998-99, 99-2000, and     diploma for the years
                                                          2000-01 was 3.5%,         1998-99 through 2001-02
                                                          4.3%, and 4.8%            was 40%, 45% and 47%,
                                                          respectively. When        respectively. When
                                                          graphed this represents   graphed, this represents a
                                                          a positive or ascending   positive or ascending
                                                          trend.                    trend.
Triangulation    Practice of comparing different sets     For Part C, a judgment    For Part B, a judgment       Note: This term is not referenced in the SPP/APR
                 of data that are designed to measure     about Family Outcomes     about parent involvement     Information Collections 1820-0624, 1820-0677, and 1820-
                 the same construct but are collected     with Part C services      and parent satisfaction      0659.
                 from different sources and/or by         might be made based on    with Part B services
                 different methods to increase            triangulation of data     might be made based on
                 certainty about the validity of the      from the Part C Parent    triangulation of data from
                 construct.                               Survey, the dispute       the Part B Parent Survey,
                                                          resolution system data    the dispute resolution
                 The process of using different           (complaints, due          system data (complaints,
                 sources of data to verify a              process hearings, etc.)   due process hearings,
                 hypothesis or conclusion.                and focus groups with     etc.) and focus groups
                                                          parents conducted         with parents conducted
                                                          during onsite             during onsite monitoring
                                                          monitoring visits.        visits.
Validity         Validity has often been understood       For Indicator C-4         For Indicator B-14, the
                 to refer to the extent to which          (Family Outcomes), the    Post-School Outcomes
                 something ―measures what it is           parent survey is          interview and self-report
                                                                                                                                                                            28
                                             Choosing a Common Language: Terms and Definitions Used for the SPP/APR
                (Reviewed/revised by the RRCP Data Priority Team and the State Data Managers Feedback Group after the June 2008 Data Meeting)
                                                                    Revised August 2009
Term                                Definition                      Part C Example              Part B Example                     SPP/APR References and Notes
                      supposed to measure.‖ For example,        considered to be a valid   is considered to be a
                      if we say that we are measuring           measure of the degree      valid measure of the
                      specific child outcomes, do our           to which early             degree to which students
                      measurement instruments really            intervention services      exiting Part B are
                      measure those particular outcomes,        have helped parents to     competitively employed,
                      and not other outcomes? One way to        know their rights,         engaged in higher
                      ascertain whether an instrument           effectively meet their     education, or both.
                      ―measures what it is supposed to          children’s needs and
                      measure‖ is to examine the items or       help their children
                      categories used by the instrument.        develop and learn.
                      Does the content of the items or
                      categories reflect what we are
                      supposed to be measuring? A
                      broader conceptualization of
                      validity, however, takes validity to
                      refer to the appropriateness of
                      interpreting specific measurements
                      for specific purposes. To establish
                      this type of validity, one needs to
                      ask how the results of measurement
                      using a particular instrument or
                      procedure relate to results using
                      other instruments or procedures that
                      purport to measure the same thing.
                      If two different measurement
                      approaches lead to the same result -
                      for example, the interpretation that a
                      state is performing very well in a
                      particular area – the agreement
                      across different instruments or
                      procedures provides strong evidence
                      for the validity of the interpretation.
Valid and reliable    Data provided are from the correct        N/A                        N/A                        Refer to SPP/APR Submission Tools on the SPP/APR
data                  time period, are consistent with 618                                                            Calendar: for Part B (click here); for Part C (click here).
                      (when appropriate) and the
                      measurement, and are consistent                                                                 Materials include, but are not limited to:

                                                                                                                                                                                29
                                                  Choosing a Common Language: Terms and Definitions Used for the SPP/APR
                     (Reviewed/revised by the RRCP Data Priority Team and the State Data Managers Feedback Group after the June 2008 Data Meeting)
                                                                         Revised August 2009
Term                              Definition                       Part C Example               Part B Example                      SPP/APR References and Notes
                      with previous indicator data (unless                                                                      B20 Rubric
                      explained).                                                                                               C14 Rubric

Validation            The process of checking if                For Indicator C-7           The state monitoring
                      something satisfies a certain             (Timeliness of IFSP),       coordinator reviews data
                      criterion.                                the LA checks to            collected by the onsite
                                                                confirm that the EI         monitoring team to
                                                                program appropriately       confirm that state
                                                                recorded the IFSP date      monitoring protocols
                                                                on the state approved       designed to collect data
                                                                IFSP form.                  during LEA onsite visits
                                                                                            have been completed
                                                                For Indicator C-1           according to
                                                                (Timely Service             specifications/guidelines.
                                                                Delivery), the LA
                                                                checks to determine if
                                                                the IFSP service dates
                                                                are within 30 days of
                                                                the IFSP date.
Verification          To determine or prove something to        For Indicator C-1           Through monitoring
                      be correct.                               (Timely Service             record reviews, the SEA
                                                                Delivery), the LA           checks to confirm that the
                                                                compares and verifies       evaluation date in the
                                                                the dates that are in the   database matches the
                                                                database to the service     evaluation date on the
                                                                provider records and/or     paper copy of the
                                                                conducts interviews         evaluation.
                                                                with parents and service
                                                                providers.
Verification visit    A component of OSEP’s                                                                              Refer to OSEP Verification/Focused Monitoring on the
(OSEP)                accountability system that involves                                                                SPP/APR Calendar: for Part B (click here); for Part C
                      an onsite visit in the state as well as                                                            (click here).
See also Focused      review of documents available on
Monitoring (OSEP).    state websites and other                                                                           Materials include, but are not limited to:
                      information. Verification is the                                                                       OSEP Verification/Focused Monitoring Manual
                      review and analysis of the state’s                                                                          (coming soon)

                                                                                                                                                                                 30
                                                  Choosing a Common Language: Terms and Definitions Used for the SPP/APR
                     (Reviewed/revised by the RRCP Data Priority Team and the State Data Managers Feedback Group after the June 2008 Data Meeting)
                                                                         Revised August 2009
Term                                  Definition                     Part C Example        Part B Example                    SPP/APR References and Notes
                        system(s). The Verification Visit                                                                CrEAG complete
                        usually does not include a local                                                                 CrEAG General Supervision
                        monitoring component. However,                                                                   CrEAG Data
                        local directors and other                                                                        CrEAG Fiscal
                        stakeholders may be interviewed
                        with respect to their role and
                        participation in the state’s system.

                        Areas for 2007 visits: General
                        Supervision, Data, and Statewide
                        Assessments.
                        Areas for 2008-2009 and 2009-2010
                        visits: General Supervision, Data,
                        and Fiscal.

Weighted risk ratio     To address potential problems that         N/A                For indicators B9 & B10    Methods for Assessing Racial/Ethnic Disproportionality in
                        SEAs may have when applying the                               (Disproportionate          Special Education: A Technical Assistance Guide, DAC,
See also Risk ratio.    risk ratio to analysis of district-level                      Representation), see       (July 2007) (click here)
                        data to determine racial/ethnic                               examples in TA
                        disproportionality, there are two                             document referenced in
                        proposed modifications – one is the                           next column.
                        weighted risk ratio. The TA
                        document referenced in the last
                        column of this row explains these
                        modifications in detail.




                                                                                                                                                                        31
                                                    Choosing a Common Language: Terms and Definitions Used for the SPP/APR
                       (Reviewed/revised by the RRCP Data Priority Team and the State Data Managers Feedback Group after the June 2008 Data Meeting)
                                                                           Revised August 2009

								
To top