Third Meeting of the National Project Managers Barcelona, Spain
Shared by: onx77558
OECD PROGRAMME FOR THE INTERNATIONAL ASSESSMENT OF ADULT COMPETENCIES (PIAAC) Third Meeting of the National Project Managers Barcelona, Spain 23-27 March 2009 Draft Agenda Overview (As of 16 January 2009) 23 March 2009 24 March 2009 25 March 2009 26 March 2009 27 March 2009 Monday Tuesday Wednesday Thursday Friday (General Session) (General Session) (Parallel Sessions) (Parallel Sessions) (Parallel Sessions) Official Welcome and Progress Report PIAAC Verification Problem Reading Numeracy BQ Literacy Sampling 9:00-10:30 and Final Checks of Solving Components Report from the OECD Training Training Training Workshop Instruments Training Training Secretariat PIAAC Field Test PIAAC Quality Problem Reading Sampling Numeracy BQ Literacy 11:00-12:30 Instruments and Control and Quality Solving Components Workshop Training Training Training Workflow Assurance Training Training 12:30-14:00 LUNCH LUNCH LUNCH LUNCH LUNCH Introduction to Survey Training and Problem Reading Sampling Integrated Computer Numeracy BQ Literacy 14:00-15:30 Operations Solving Components Workshop Delivery Platform Training Training Training Training Training PIAAC Technical Standards and Problem Reading Sampling Guidelines Numeracy BQ Literacy 16:00-17:30 System Integration Solving Components Workshop Training Training Training Training Training Printing Needs for the Paper Booklets Red= NPM needed Green=Content expert/translators needed Blue=Sampling experts needed OECD PROGRAMME FOR THE INTERNATIONAL ASSESSMENT OF ADULT COMPETENCIES (PIAAC) Third Meeting of the National Project Managers Barcelona, Spain 23-27 March 2009 Draft Agenda (As of 16 January 2009) Monday, 23 March 2009 (General Session) 1. 9:00–10:00 Official Welcome and Progress Report 1.1. Irwin Kirsch (ETS) will initiate the meeting, present the purpose of the meeting, and present the agenda for approval 1.2. Irwin Kirsch (ETS) will present a progress report. 10:00–10:30 Report from the OECD Secretariat 1.3. William Thorn (OECD Secretariat) will provide a briefing on the status of the project with particular reference to implications for NPM activities. 2. 11:00–12:30 PIAAC Field Test Instruments and Workflow 2.1. Claudia Tamassia (ETS) will provide an update of the field test design, describe the test development process; introduce the final field test instruments and described the field test workflow. 3. 14:00–15:30 Integrated Computer Delivery Platform 3.1. Heiko Roelke (DIPF) and Ingo Barkow (DIPF) will present the PIAAC integrated computer deliver platform. 4. 16:00–17:30 System Integration 4.1. Heiko Roelke (DIPF) and Ingo Barkow (DIPF) will present the process of system integration and discuss next steps. Tuesday, 24 March 2009 (General Session) 5. 9:00–10:30 PIAAC Verification and Final Checks of Instruments 5.1. Andrea Ferrari and/or Steve Dept (cApStAn) will describe the complete workflow of the verification process from upload of the translated/adapted version(s) by the country to signing off on the final versions after a final check. This process includes linguistic quality control and equivalence check + checking scoring definitions (items - first round); verification of (language-dependent) adaptation and translation issues in the BQ (BQ - first round); comparing PBa to CBa versions (items - second round); checking key corrections (items - second round); and documentation of verifier interventions (both rounds). 6. 11:00–12:30 PIAAC Quality Control and Quality Assurance 6.1. Irwin Kirsch (ETS), Pat Montalvan and Leyla Mohadjer (Westat) will describe the process of quality assurance and quality control in PIAAC. The presentation will focus on the revised strategy for PIAAC emphasizing the quality control report, and aspects of quality control for survey operations and sampling. Westat will provide examples (handouts) of the kinds of items that will be monitored for sampling and survey operations. 7. 14:00–15:30 Introduction to Survey Training and Operations 7.1. Pat Montalvan (Westat) will present information about the survey training and operations. 8. 16:00–17:00 PIAAC Technical Standards and Guidelines 8.1. Leyla Mohadjer (Westat) will discuss the revised version of the PIAAC Technical Standards and Guidelines, emphasizing implications to the field test. 17:00-17:30 PIAAC Printing Needs for the Paper Booklets 8.2. Danielle Baum will discuss the process of producing the paper booklets including printing needs, file preparation, requirements for the booklets (i.e., size (A4 or letter) saddle-stitching, weight of paper, etc.). This will be accompanied by individual consultations with countries. Wednesday, 25 March 2009 (Parallel Sessions) 9. 9:00–17:30 PIAAC Numeracy Training 9.1. The consortium will conduct an item-by-item translation and adaptation training for all numeracy new items. OR PIAAC Problem Solving Training 9.2. The consortium will conduct an item-by-item translation and adaptation training for all problem solving items. Thursday, 26 March 2009 (Parallel Sessions) 10. 9:00–17:30 PIAAC Background Questionnaire Training 10.1. This session is an item-by-item translation and adaptation training for the background questionnaire. General translation guidelines, including common pitfalls, will be introduced in order to provide a framework for the BQ translation. Based on this general introduction, the item-by-item translation guidelines will be presented. Time will be set aside for practice and discussion. In addition, the workflow for the BQ as supported by the Item Management Portal will be explained. The session should be attended by the NPM, the translators/reviewer(s) and any other persons involved in the translation process of the BQ. OR PIAAC Literacy Training 10.1. The consortium will conduct an item-by-item translation and adaptation training for all literacy new items. Friday, 27 March 2009 (Parallel Sessions) 11. 9:00–17:30 PIAAC Reading Components Training 11.1. The consortium will conduct an item-by-item translation and adaptation training for the reading components assessment. OR PIAAC Sampling Workshop 11.2. The consortium will conduct a sampling workshop that is intended to provide an overall technical information and support to the National Sampling Managers (NSMs). The instructors (Leyla Mohadjer, Tom Krenzke, and Wendy Van de Kerckhove (Westat)) will mainly focus on the technical aspects of the sample design and selection for the main survey and the field test. Weighting, variance estimation and nonresponse bias analysis will be briefly discussed. In addition, instructions for filling out the sampling QC forms will be given in this workshop.