Get documents about "Third Meeting of the National Project Managers Barcelona, Spain
Document Sample
OECD PROGRAMME FOR THE INTERNATIONAL ASSESSMENT OF ADULT COMPETENCIES
(PIAAC)
Third Meeting of the National Project Managers
Barcelona, Spain
23-27 March 2009
Draft Agenda Overview (As of 16 January 2009)
23 March 2009 24 March 2009 25 March 2009 26 March 2009 27 March 2009
Monday Tuesday Wednesday Thursday Friday
(General Session) (General Session) (Parallel Sessions) (Parallel Sessions) (Parallel Sessions)
Official Welcome and
Progress Report
PIAAC Verification Problem Reading
Numeracy BQ Literacy Sampling
9:00-10:30 and Final Checks of Solving Components
Report from the OECD Training Training Training Workshop
Instruments Training Training
Secretariat
PIAAC Field Test PIAAC Quality Problem Reading Sampling
Numeracy BQ Literacy
11:00-12:30 Instruments and Control and Quality Solving Components Workshop
Training Training Training
Workflow Assurance Training Training
12:30-14:00 LUNCH LUNCH LUNCH LUNCH LUNCH
Introduction to
Survey Training and Problem Reading Sampling
Integrated Computer Numeracy BQ Literacy
14:00-15:30 Operations Solving Components Workshop
Delivery Platform Training Training Training
Training Training
PIAAC Technical
Standards and
Problem Reading Sampling
Guidelines Numeracy BQ Literacy
16:00-17:30 System Integration Solving Components Workshop
Training Training Training
Training Training
Printing Needs for the
Paper Booklets
Red= NPM needed Green=Content expert/translators needed Blue=Sampling experts needed
OECD PROGRAMME FOR THE INTERNATIONAL ASSESSMENT OF ADULT COMPETENCIES
(PIAAC)
Third Meeting of the National Project Managers
Barcelona, Spain
23-27 March 2009
Draft Agenda (As of 16 January 2009)
Monday, 23 March 2009 (General Session)
1. 9:00–10:00 Official Welcome and Progress Report
1.1. Irwin Kirsch (ETS) will initiate the meeting, present the purpose of the
meeting, and present the agenda for approval
1.2. Irwin Kirsch (ETS) will present a progress report.
10:00–10:30 Report from the OECD Secretariat
1.3. William Thorn (OECD Secretariat) will provide a briefing on the status of
the project with particular reference to implications for NPM activities.
2. 11:00–12:30 PIAAC Field Test Instruments and Workflow
2.1. Claudia Tamassia (ETS) will provide an update of the field test design,
describe the test development process; introduce the final field test
instruments and described the field test workflow.
3. 14:00–15:30 Integrated Computer Delivery Platform
3.1. Heiko Roelke (DIPF) and Ingo Barkow (DIPF) will present the PIAAC
integrated computer deliver platform.
4. 16:00–17:30 System Integration
4.1. Heiko Roelke (DIPF) and Ingo Barkow (DIPF) will present the process of
system integration and discuss next steps.
Tuesday, 24 March 2009 (General Session)
5. 9:00–10:30 PIAAC Verification and Final Checks of Instruments
5.1. Andrea Ferrari and/or Steve Dept (cApStAn) will describe the complete
workflow of the verification process from upload of the translated/adapted
version(s) by the country to signing off on the final versions after a final
check. This process includes linguistic quality control and equivalence
check + checking scoring definitions (items - first round); verification of
(language-dependent) adaptation and translation issues in the BQ (BQ -
first round); comparing PBa to CBa versions (items - second round);
checking key corrections (items - second round); and documentation of
verifier interventions (both rounds).
6. 11:00–12:30 PIAAC Quality Control and Quality Assurance
6.1. Irwin Kirsch (ETS), Pat Montalvan and Leyla Mohadjer (Westat) will
describe the process of quality assurance and quality control in PIAAC.
The presentation will focus on the revised strategy for PIAAC emphasizing
the quality control report, and aspects of quality control for survey
operations and sampling. Westat will provide examples (handouts) of the
kinds of items that will be monitored for sampling and survey operations.
7. 14:00–15:30 Introduction to Survey Training and Operations
7.1. Pat Montalvan (Westat) will present information about the survey training
and operations.
8. 16:00–17:00 PIAAC Technical Standards and Guidelines
8.1. Leyla Mohadjer (Westat) will discuss the revised version of the PIAAC
Technical Standards and Guidelines, emphasizing implications to the field
test.
17:00-17:30 PIAAC Printing Needs for the Paper Booklets
8.2. Danielle Baum will discuss the process of producing the paper booklets
including printing needs, file preparation, requirements for the booklets
(i.e., size (A4 or letter) saddle-stitching, weight of paper, etc.). This will be
accompanied by individual consultations with countries.
Wednesday, 25 March 2009 (Parallel Sessions)
9. 9:00–17:30 PIAAC Numeracy Training
9.1. The consortium will conduct an item-by-item translation and adaptation
training for all numeracy new items.
OR
PIAAC Problem Solving Training
9.2. The consortium will conduct an item-by-item translation and adaptation
training for all problem solving items.
Thursday, 26 March 2009 (Parallel Sessions)
10. 9:00–17:30 PIAAC Background Questionnaire Training
10.1. This session is an item-by-item translation and adaptation training for the
background questionnaire. General translation guidelines, including
common pitfalls, will be introduced in order to provide a framework for the
BQ translation. Based on this general introduction, the item-by-item
translation guidelines will be presented. Time will be set aside for practice
and discussion. In addition, the workflow for the BQ as supported by the
Item Management Portal will be explained. The session should be
attended by the NPM, the translators/reviewer(s) and any other persons
involved in the translation process of the BQ.
OR
PIAAC Literacy Training
10.1. The consortium will conduct an item-by-item translation and adaptation
training for all literacy new items.
Friday, 27 March 2009 (Parallel Sessions)
11. 9:00–17:30 PIAAC Reading Components Training
11.1. The consortium will conduct an item-by-item translation and adaptation
training for the reading components assessment.
OR
PIAAC Sampling Workshop
11.2. The consortium will conduct a sampling workshop that is intended to
provide an overall technical information and support to the National
Sampling Managers (NSMs). The instructors (Leyla Mohadjer, Tom
Krenzke, and Wendy Van de Kerckhove (Westat)) will mainly focus on the
technical aspects of the sample design and selection for the main survey
and the field test. Weighting, variance estimation and nonresponse bias
analysis will be briefly discussed. In addition, instructions for filling out the
sampling QC forms will be given in this workshop.
Related docs
