err1-08 CELDT (CA Dept of Education)

Document Sample
err1-08 CELDT (CA Dept of Education) Powered By Docstoc
					                         ERRATUM #1 – November 7, 2008
     Request for Proposals for the California English Language Development Test
                                     2009 – 2012

SECTION 3.0 – SCOPE OF THE PROJECT

Section 3.1 – (Task 1) Project Management, Meetings, and Project Deliverables

 3.1.A Overlap of Contracts and Continuity of Assessment, Table 1. Overview of the
   Transition Process. Clarify K-1 Early Literacy Assessment deliverables.
   Delete:
   Table 1.
   Replace:
   Table 1. Overview of the Transition Process
       Year              CTB                   WestEd                  New Contract
                                        ▪ Approved items to     ▪ 2009-10 Pre-admin
                                        populate the 2008-09    workshops
                                        Field Test in K-1       ▪ K-1 Field Test, late
                  ▪ K-12
                                        reading and writing     winter/early spring 2009
                  administration*
      2008-09                                                   ▪ Develop 2009-10 K-1
                  ▪ Develop 2009-10
                                                                reading and writing test and
                  test and materials
                                                                materials
                                                                 ▪ Develop 2010-12 test,
                                                                materials and score reports
                                                                ▪ K-12 complete
      2009-10     ▪ Final reports**
                                                                administration in all domains
   *Refer to Section 2.3 for the assessment of domains.
   **Refer to Table 2 for kinds of reports

 3.1.A.2 Overlap of Contracts and Continuity of Assessment, last line
   Delete:
   “The transition process includes the following points.”

 3.1.A.2 Overlap of Contracts and Continuity of Assessment, Table 2.
   Delete:
   Table 2




CELDT RFP Erratum #1                                                         Page 1 of 14
   Replace:
   Table 2. Major Deliverables by new CELDT Contractor by CELDT Edition
                                                                            Released    Reporting,
                Training          Test          Printing/        Scoring      Test       Data Files
      CELDT     Workshop        Materials      Distribution     and Score   Questions   and Annual     Technical
      Edition   Materials     and Manuals        System          Reports     (RTQs)       Results       Report
      2009-10     RFP            RFP*              RFP            RFP         RFP          RFP           RFP
      2010-11     RFP             RFP              RFP            RFP                      RFP           RFP
      2011-12     RFP             RFP              RFP            RFP         RFP          RFP           RFP
      2012-13    RFP2             RFP             RFP2            RFP2                     RFP2          RFP2

                Successful bidder administers CELDT with materials
       RFP*     delivered under current contract
       RFP      Successful Bidder
       RFP2     Next Contractor (10-1-2011 to 12-31-2015)

 3.1.A.3 Overlap of Contracts and Continuity of Assessment, first paragraph
   Delete:
   “on or about October 1, 2012.”
   Replace:
   “on or about October 1, 2011.”

 3.1.A.3 Overlap of Contracts and Continuity of Assessment, second paragraph
   Delete:
   “By October 1, 2012”
   Replace:
   “By March 15, 2012”

 3.1.A Overlap of Contracts and Continuity of Assessment, Table 3.
   Delete:
   Table 3.
   Replace:
   Table 3. File Formats of Electronic Deliverables from the Successful Bidder

    Deliverables                                   File Format

    Data                                           Fixed-length, comma delimited text files, SQL

    Reports                                        MS Word and Adobe Acrobat (upon prior CDE approval)

    Web Applications                               ASPX*



CELDT RFP Erratum #1                                                                           Page 2 of 14
    Test Forms                              Adobe Acrobat and InDesign

    Braille Special Test Versions           Readable by Braille.2000 with .abt or .bml extensions

    Large-Print Special Test Versions       MS Word and Adobe Acrobat (upon prior CDE approval)

    CD-ROM Special Test Versions            .pdf

    Audio CD                                Windows Media File or MP3

    Item Response Factors                   Fixed-length and delimited files

    Item Graphics                           .tif and .eps

    * Subject to change based on CDE Web posting standards.


 3.1.F CALPADS Meetings, second sentence
   Delete:
   “The successful bidder must participate in the testing of the CALPADS interface beginning
   with the pre-identification process in the spring of 2009.”
   Replace:
   “The successful bidder must participate in the preparation and testing process of the
   CALPADS interface beginning with the Pre-identification process in 2010

SECTION 3.2 – (Task 2) ITEM DEVELOPMENT

 3.2.A.1 K-1 Early Literacy Field Testing, paragraph 1, line 5.
   Delete:
   “in spring 2009.”
   Replace:
   “in late winter/early spring 2009.”

 3.2.B Overall K-12 Item Development, Table 4.
   Delete:
   Table 4 (exclusive of the footnote).




CELDT RFP Erratum #1                                                            Page 3 of 14
   Replace:
   Table 4. Breakdown of Total Items per Edition (2010-11 through 2012-13)
                            Minimum number of       Minimum number of          Approximate
             Grade              items to be          items to be field        number of new
             Span            submitted to CDE         tested on each         operational items
                              for each Edition           Edition*             on each Edition
             K-1
                                      42                      28                     14
    Reading and Writing
             K-2
     (K-2 Listening and
                                      94                      62                     30
     Speaking; Grade 2
    Reading and Writing
             3-5                      94                      62                      30
             6-8                      94                      62                      30
            9-12                      94                      62                      30
          TOTALS                     418                     276                     134

 3.2.B.4.b Item Writer Training, second paragraph
   Delete:
   Second paragraph.
   Replace:
   “The proposal must specify that annual item writer training will be conducted each spring,
   beginning in spring 2009. At least three item writer trainings must be conducted during the
   contract period in Sacramento with all item writers present. The dates and locations must
   be negotiated with and approved by CDE at least 40 working days prior to the item writer
   training dates. The successful bidder is responsible for all costs related to item writer
   training, including but not limited to, facility, travel, expenses, and per diem for item writers,
   and training materials.”

 3.2.B.4.b Item Writer Training, third paragraph, third line
   Delete: “workshop”

 3.2.E.1.a Review and revision process between item writers and contractor, first line
   Delete:
   “When reviewing newly written items the successful bidder”
   Replace:
   “When reviewing newly written items and any associated passages, the successful bidder”

 3.2.E.2.a Content Review Panel, first sentence in second paragraph
   Delete:
   “36”


CELDT RFP Erratum #1                                                               Page 4 of 14
   Replace:
   “32”

 3.2.E.2.a Content Review Panel, delete Fall 2012, and correct spelling in the last
   sentence.
   Delete:
   Last two sentences of the second paragraph.
   Replace:
   “The proposal must identify how the successful bidder will conduct at least a two-day
   review meeting annually (Fall 2009, Fall 2010, and Fall 2011). Contractor-provided test
   content specialists must attend all content reviews to facilitate all content-related
   discussions of the separate grade span groups.”

SECTION 3.3 – (Task 3) TEST DEVELOPMENT

 3.3.B Test Specifications, next to the last sentence
   Delete:
   “The successful bidder must provide the test specifications to CDE within 10 working days
   of a request.”
   Replace:
   “The successful bidder must provide CDE with the test specifications at least 20 days prior
   to the delivery of item writer training materials for CDE review or within 10 working days
   upon CDE request if changes have been made.”

 3.3.C Test Form Production, Table 5
   Delete:
   Table 5
   Replace:
   Table 5. Number of Test Forms to be Developed
                                      Maximum                        Maximum
                                number of test forms          number of special test
                                   to be developed          versions to be developed
          Test Edition
                              (K-1, grade 2, grade span     (K-1, grade 2, grade span
                              3-5, grade span 6-8, and       3-5, grade span 6-8, and
                                   grade span 9-12)              grade span 9-12)
             2010-11           12 forms x 5 grade spans     3 versions x 5 grade spans
             2011-12           12 forms x 5 grade spans     3 versions x 5 grade spans
             2012-13           12 forms x 5 grade spans     3 versions x 5 grade spans
              Total                       180                           45




CELDT RFP Erratum #1                                                         Page 5 of 14
 3.3.D Test Form Construction, added a definition for “item card” in Section 4.2.
   Insert at the end of the third bullet:
   “See RFP Section 4.2.”

SECTION 3.4 – (Task 4) TEST ADMINISTRATION

 Section 3.4.A.1, insert new table
   Insert:
   Table 7. Estimated Number of Test Takers by Edition
      Edition     Estimated Number of Test Takers*
     2009-10                 2,035,635
     2010-11                 2,090,660
     2011-12                 2,200,754

   *Includes 10 percent Overage by Edition

 3.4.A.2 Web-based Ordering System, second paragraph
   Delete:
   “special”

 3.4.B.2.a Pre-ID Data Entry, page 35, third sentence
   Delete:
   “SSIDs appear within or across schools or LEAs.”
   Replace:
   “Duplicate SSIDs may appear within or across schools or LEAs.”

 3.4.B.2.b Accuracy of Pre-ID, insert a new sentence after the second sentence, and
   maintain all other text.
   Insert:
   “The proposal must identify how the successful bidder will develop and implement a
   voluntary pre-identification process to supply Pre-ID labels using an electronic database to
   LEAs that request this service at their own expense.”

 3.4.B.2.d Tracking, last sentence
   Delete:
   “There must be 100 percent accounting of all test booklets and answer documents.”
   Replace:
   “There must be 100 percent accounting of all boxes of test booklets and answer documents
   shipped.”



CELDT RFP Erratum #1                                                          Page 6 of 14
 3.4.D Data Correction System, paragraph 4, first sentence
   Insert:
   “Within 10 working days of the approval of the corrected statewide student level data file by
   CDE, the successful bidder must provide LEAs with updated student level data files that
   LEAs may download via the successful bidder’s secure Web site.”

 3.4.E Data Management, Processing, and Correction Systems
   Delete:
   Section 3.4.E Data Management, Processing, and Correction Systems in its entirety.
   Replace:
   Section 3.4.E Data Management and Processing Systems
   In the proposal, the successful bidder must describe the database systems that will be
   developed, maintained, and used for the CELDT to process, score, and correct answer
   documents and test booklets. The proposal must describe the development of an efficient
   data management system to facilitate all aspects of the CELDT administration, including,
   but not limited to, Pre-ID, testing material ordering, demographic data corrections, and
   reporting. The proposal must describe the quality control checks to be included in the
   database management systems and implemented by the successful bidder.

SECTION 3.5 – (Task 5) TEST MANUALS, TRAINING, AND SUPPPORT MATERIALS

 3.5 (Task 5) Test Manuals, Training, and Support Materials, insert new section.
   Insert:
   3.5.E Released Test Questions
   In the spring of 2010 and spring of 2012, immediately after test forms are assembled for the
   2010-2011 and 2012-13 CELDT Editions respectively, the successful bidder must identify
   from the item database, a set of items that can be released and included in the Released
   Test Questions (RTQ) document. The successful bidder must make recommendations to
   CDE on the content of the current RTQ document in terms of items to remove or replace
   before reposting the updated RTQ document on the Internet. The set of items must be
   presented to CDE for final selection and approval. All items in the set must be statistically
   sound and represent a range of ELD Standards. There must be at least two items per test
   component (representing all grade spans and domains) selected for review by CDE for
   potential release.

 3.5.A Test Administration Manuals, first paragraph, third line
   Delete:
   “(1) district and test site coordinator’s manuals that contain specific instructions for handling
   testing materials and working with test site coordinators and training test examiners to
   administer and score the CELDT;”




CELDT RFP Erratum #1                                                             Page 7 of 14
   Replace:
   “(1) a district and test site coordinators’ manual that contains specific instructions for
   handling testing materials and working with test site coordinators and training test
   examiners to administer and score the CELDT;”

 3.5.B Required Training Workshops and Webcasts, change in section title
   Delete:
   “Webcasts”
   Replace:
   “Web-based Trainings”

 3.5.B.2 Scoring Training of Trainers Workshops
   Delete:
   Entire paragraph
   Replace:
   “2. Scoring Training of Trainers Workshops. The proposal must include the annual
   development and presentation of a total of 24 scoring training workshops that must be
   conducted beginning in April 2009 and each year thereafter through April 2011. The scoring
   workshops must focus on valid and reliable local scoring of the CELDT. The official score
   for the speaking domain is provided through local scoring. At least twenty scoring training
   workshops must be administered annually from April to June prior to the beginning of the
   annual and initial identification assessment windows for the upcoming school year. Four
   make-up workshops must be scheduled from July to August for LEAs that cannot
   participate prior to July 1. All participants who complete the scoring training must be
   supplied with certificates of completion.”

 3.5.B.3 Data Analysis, Interpretation, and Use Workshops
   Delete:
   Entire paragraph
   Replace:
   “3. Data Analysis, Interpretation, and Use Workshops. The proposal must include the
   annual development and presentation of at least six live data analysis, interpretation, and
   use workshops that must be conducted annually from November to December, beginning in
   fall 2009, after the conclusion of the annual assessment window on October 31. At least
   four Web-based trainings must be produced on the same topic and must be archived for at
   least 12 months to allow for Internet access to the same content of the data analysis,
   interpretation, and use workshops.”




CELDT RFP Erratum #1                                                              Page 8 of 14
 3.5.C Training Video and DVDs
   Delete:
   First two paragraphs and the first sentence of third paragraph.
   Replace:
   “The proposal must describe the annual development, production, and distribution of a
   general test administration DVD and a scoring training video on DVD accompanied by a
   paper copy of each script. The DVDs, which will be used during the general test
   administration and scoring workshops, and subsequently in local training sessions to train
   test site coordinators and test examiners, must include a closed captioning option. (Note:
   The closed captioning does not take place of the text only version.)

   Each year, the successful bidder must develop, produce, and distribute the general test
   administration and scoring training DVDs, and produce and distribute the scoring training
   video on VHS upon request, to all LEAs that administer the CELDT.

   Beginning spring 2009, the successful bidder must annually develop, produce and
   distribute at least 1,500 DVDs each for the general test administration and the scoring
   training.”

 3.5.D Interpretive Support Resources
   Delete:
   First and second sentences.
   Replace:
   “The proposal must address how the successful bidder will design and produce interpretive
   support materials, including, but not limited to, a glossary of key terms, test results
   interpretation guide, and parent and teacher brochures. The proposal must describe how
   the successful bidder will produce additional language versions of the glossary, test results
   interpretation guide, and parent brochures, including, but not limited to, the top ten
   languages per the number of ELs by language as reported by the CDE on DataQuest.”

SECTION 3.6 – (Task 6) TEST SECURITY

 3.6.C Test Security Reporting
   Delete:
   Entire paragraph
   Replace:
   “A report of missing materials must be prepared for all test booklets and answer documents
   based on the scanning and checking that is completed during materials check-in by the
   successful bidder. A process must be identified in the proposal for accounting for the test
   materials that will not be returned, but rather will be securely destroyed by LEAs at the end
   of each school year. The successful bidder must report missing boxes to CDE immediately



CELDT RFP Erratum #1                                                          Page 9 of 14
   and conduct a search to locate boxes not received at the shipping center. See RFP Section
   3.4.B.2.d.”

 3.6.E Confidentiality of Student Results, second paragraph
   Delete:
   “The State of California requires that anyone having access to confidential data must attend
   annual privacy training.”

 3.6.E Confidentiality of Student Results, third paragraph
   Delete:
   “In addition, the procedures should include the steps the successful bidder will take to
   satisfy state mandatory disclosure requirements related to a privacy breach.”

SECTION 3.8 – (Task 8) ANALYSIS OF TEST RESULTS

 3.8.D Replication, insert new sentence at the end of the paragraph
   Insert:
   “The successful bidder must provide CDE with two licenses of proprietary software for use
   on CDE computers.”

SECTION 3.9 – (Task 9) REPORTING OF TEST RESULTS

 3.9.B.4 Design of Reports and Labels, second paragraph, second sentence
   Delete:
   Entire sentence.
   Replace:
   “The labels must contain pupil name, SSID, school, district, CDS number, grade, birth date,
   date tested, gender, ethnicity, primary language, Local ID number, test purpose, and test
   edition.”

 Section 3.9.C.1.c Electronic Student Data Files
   Delete:
   “c. Web-based application so that LEAs and CDE can generate custom reports and
   analyses using the student level data.”

SECTION 4.0 – GENERAL PROPOSAL INFORMATION

 Section 4.2 – Definitions, insert after “Form X”
   Insert:
   ““Item card” refers to the template in which new items are submitted to CDE for approval
   prior to content and bias reviews and field testing. Item cards must contain item text,


CELDT RFP Erratum #1                                                          Page 10 of 14
   applicable graphics, and item specifications (including, but not limited to, Item ID, ELD
   standard, grade span, domain, test component, correct answer, and item type). Operational
   item cards must also contain statistical information.”

 Section 4.8 – Time Schedule
   Delete:
   Entire schedule
   Replace:
                          ACTIVITY                                         DATE
    Request for Proposals (RFP) Released               October 7, 2008

    Bidders’ Conference                                October 15, 2008 (2:00 p.m. PT)

    Intent to Submit a Proposal Due (Mandatory)        October 21, 2008 (5:00 p.m. PT)

    Receipt of Questions from successful bidders Due   October 21, 2008 (5:00 p.m. PT)

    Responses to Questions Posted on CDE Web Site      November 6, 2008 (5:00 p.m. PT, Tentative)

    Proposals Due                                      November 21, 2008 (12:00 p.m. PT)

    Review of Proposals                                November 24 – 26, December 1-2, 2008
                                                       (Tentative)
    Bid Opening Date                                   December 10, 2008 (10:00 a.m. PT)

    Posting of Intent to Award                         December 15 – 19, 2008 (Tentative)
    Contract Start Date                                January 1, 2009
                                                       (contingent upon DGS approval)

SECTION 5.0 – PROPOSAL SPECIFICATIONS

 Section 5.4.G. Attachments, second bullet
   Delete:
   Second bullet
   Replace:
   “The Small Business Preference Sheet (RFP Attachment 1) must be completed with an
   original signature on the form included in the ORIGINAL Technical Proposal. If the
   preference is being claimed, a copy of the certification letter from the Office of Small
   Business and Disabled Veterans Business Enterprise Services (OSDS) or any proof of
   certification by the State of California, including an email or a Web site print out, must be
   included or date of application indicated if not certified.”




CELDT RFP Erratum #1                                                            Page 11 of 14
 Section 5.4.G. Attachments, third bullet
   Delete:
   Third bullet
   Replace:
   “The DVBE attachments in accordance with the instructions in Attachment 3 (Attachment 3-
   A, commitment letter and OSDS certification letter or any proof of certification by the State
   of California, including an e-mail or a website print out for each participating DVBE). See
   sections 5.2 and 5.3 of this RFP for more information.”

 Section 5.5 Cost/Price Proposal
   Delete:
   First two paragraphs
   Replace:
   “Cost Proposals must be submitted in a separately sealed envelope, marked as specified in
   Section 5.1. The contract will be awarded to the lowest responsible bidder meeting the
   requirements of this RFP. The lowest responsible bidder will be determined by the lowest
   total amount for the overall contract. The resulting contract will be a cost reimbursement
   contract based on the estimated number of test takers. The contractor is responsible for
   providing administrative tasks, scoring, and reporting for all assessments administered from
   July 1, 2009 through June 30, 2012.

   The bidder shall use the estimated number of test takers as provided in Table 7 in the cost
   proposal. If the number of test takers exceeds the estimated numbers as stated in Section
   3.4.A, Table 7, the contractor is responsible for all costs associated with the increased
   number of test takers (including, but not limited to, production, packaging, distribution,
   scoring, analysis, and reporting) and will receive no additional compensation. If the actual
   number of test takers is less than the number of test takers stated in Section 3.4.A, Table 7,
   the contractor will be reimbursed for fixed costs and for the actual number of test takers at
   the per pupil rate.”

SECTION 11.0 RATING CRITERIA AND EVALUATION FORMS

 Step I, Part 1 – Adherence to Proposal Requirements, Required Attachments, 9.b
   Delete:
   Entire paragraph
   Replace:
   “The Small Business Preference Sheet (RFP Attachment 1) must be completed with an
   original signature on the form included in the ORIGINAL Technical Proposal. If the
   preference is being claimed, a copy of the certification letter from the Office of Small
   Business and Disabled Veterans Business Enterprise Services (OSDS) or any proof of
   certification by the State of California, including an email or a Web site print out, must be
   included or date of application indicated if not certified.”


CELDT RFP Erratum #1                                                            Page 12 of 14
 Step 1, Part 1 – Adherence to Proposal Requirements, Required Attachments, 9.c
   third bullet
   Delete:
   Entire bullet
   Replace:
   “Certification letter from OSDS or any proof of certification by the State of California,
   including an email or Web site print out for each participating DVBE.”

 Step I, Part 2 – Technical Evaluation, Section 3.5 Task 5 – Test Manuals, Training,
   and Support Materials, edit fifth bullet and add a sixth bullet
   Delete:
      “How well does the bidder demonstrate its ability to produce instructional support
       resources including updating student study guides, teacher guides, and released test
       questions?”
   Replace:
      “How well does the bidder demonstrate its ability to produce interpretive support
       resources including, but not limited to, glossary of terms, test results interpretation
       guides, parent and teacher brochures as well as have them translated into the top ten
       languages?”
      “How well does the bidder demonstrate the ability to identify released test questions for
       the two required updates of the Released Test Questions document?”

 Step II, Part 1, Adherence to Cost Proposal Requirements, Task Detail, first bullet
   Delete:
   “and staffing titles in the Management and Staffing section”
   Replace:
   “and staff in the Management and Staffing section”

 Attachment 1, Small Business Preference Sheet
   Delete:
   (916) 375-4400
   Replace:
   (916) 375-4940

   Delete:
   State Office of Small Business and DVBE Certification (OSDC)
   Replace:
   State Office of Small Business and DVBE Certification (OSDS)


CELDT RFP Erratum #1                                                            Page 13 of 14
   Delete:
   “If you are claiming the preference, you MUST attach a copy of your certification letter from
   OSDC.”
   Replace:
   “If you are claiming the preference, you MUST attach a copy of your certification letter from
   OSDS or any proof of certification by the State of California, including an email or a Web
   site print out.”

Attachment 3 – California Disabled Veteran Business Enterprise Program Requirements
 Option A – Commitment to DVBE Participation, page 2 of 9
   Method A1. Certified DVBE Bidder, third bullet, first sentence
   Delete:
   First sentence
   Replace:
   “A letter of commitment prepared by other participating DVBE subcontractor(s)/supplier(s),
   including the goods or services being provided, and a copy of the OSDS DVBE certification
   letter or any proof of certification by the State of California, including an e-mail or website
   print out for each participating DVBE, must also be attached to the DVBE 1.”

 Option B – Good Faith Effort (GFE), page 4 of 9
   Step 2: Contact Other State and Federal Agencies and Local Organizations, website
   address
   Delete:
   http://www.pd.dgs.ca.gov/smbus
   Replace:
   http://www.pd.dgs.ca.gov/smbus/default.htm.

 Resources and Information, page 7 of 9, website address
   Delete:
   http://www.pd.dgs.ca.gov/smbus
   Replace:
   http://www.pd.dgs.ca.gov/smbus/default.htm.




CELDT RFP Erratum #1                                                           Page 14 of 14