phases dpietersen

Document Sample
phases dpietersen Powered By Docstoc
					PRESENTATION INFORMATION



DIVISION:    STATISTICS SOUTH AFRICA, SOCIAL STATISTICS
PROJECT:     NATIONAL HOUSEHOLD TRAVEL SURVEY
PRESENTER:   DION PIETERSEN, STATS SA
STATUS:      FINAL
TITLE:       PHASES OF CONDUCTING A NATIONAL TRAVEL SURVEY
                       Flow Chart for Household Survey Projects


                                      First Process
                                      Development
                                                                  Task team designs /
                                                                  reviews
                                       Process ends               questionnaire and
                                                                  manuals
                                           No
                                                                                                   Documents are sent for
                                                            Consultation with Provincial offices   printing
        DDG at Head      The EM at                                                                 Questionnaire, manuals, listing
        Office           Social        Funds          Yes                                          forms, other admin forms
Start                                                                Task team plans
        confirms go      Statistics    available
        ahead of the     confirms                                    the project –
        specific         funds                                       including sample
        project                                                      design and
                                                                     selection




                                                                                                   Task team receives
                                                                                                   back printed material
                                   Second Process
                                   Publicity

                               Supplier
                               provides
                               publicity
                               material



Publicity       Publicity    Material      Material is
officer at HO   Material     received at   distributed                      Head office       Where PSUs have
plans           ordered by   Head          to                               receives          undergone a change in
publicity       publicity    Office        provincial                       biweekly          status, Head office
project         officer                    offices                          reports on        requests re-listings and
                                                                            publicity         re-samples



Consultation                               Provinces     Provincial         Progress is
with                                       receive       offices identify   reported to
Provincial                                 material      PSUs and DUs       Head office
offices on
quotations

                                                         Quality of                                       Report
                                                         sample verified        80% Dus                   back to
                                                         at regional                            No        Head
                                                                                identified
                                                         level                                            office




                                                                                  Yes




                                                                            Household that
                                                                            occupy the
                                                                            sampled Dus
                                                                            are informed of
                                                                            the project
                                    Third Process
                                    Training

                                       Retraining
                                       and re-
                                       evaluation



                                        No

Task team     Quality of training
provides      is tested through
training to   evaluation                90%                                                        Retraining
PSMs and      exercises with 90%                      Yes                                          and re-
                                                                                       No          evaluation
QAs           target


                                                    PSMs and     Quality of training
                                                    QAS train    is tested through
                                                    RSMs at      evaluation                        Yes
                                                    provincial
                                                                                       90%
                                                                 exercises with 90%
                                                    level
                                                                 target


                                                                 Provincial                                        Retraining
                                                                 HR recruits                     RSMs train        and re-
                                                                 fieldstaff                      fieldworkers
                                                                                                 at regional
                                                                                                                   evaluation
                                                                 -Geography
                                                                                                 level
                                                                 -Profile
                                                                 -Evaluation /
                                                                 competency                                           No
                                                                 exercise
                                                                                             Quality of training
                                                                                             is tested through
                                                                                             evaluation               85%
                                                                                             exercises with 85%
                                                                                             target


                                                                                               Fieldwork
                                                                                               preparations           Yes
                                                                                               at regional
                                                                                               level
                                       Fourth Process
                                       Field Operations


Head office          Material is                                   Head office                  Head office
material             distributed                                   resamples                    receives the
procurement          to provincial                                                              report
                     offices                                                                    biweekly



     Provincial offices receive      Material is
     material; field teams are       distributed                                                Survey clerk
     formed per regional office      to regional                  Report to                     report
                                     offices                      Head Office                   biweekly to
                                                                                                head office

                                     Regional      Material is
                                     offices       distributed
                                     receive       to field         No                          RSMs report
                                     material      teams                                        daily to
                                                                                                Survey clerk

                                                   Field teams
                                                   receive        80% of
                                                   material and   sampled          Yes
                                                                  Dus
                                                   identify
                                                                  covered
                                                   PSUs and
                                                   DUs



                                                                                                Supervisors
                                                                                 Interviewing   report daily
                                                                                 takes place    to RSM
                                             Fifth Process
                                             Quality Assurance

RSM at                 RSM submits
regional               questionnaires                            Questionnaires
offices verifies       back to                                   sent back to
that all PSUs          provincial office                         regional office
were                                                             for verification
enumerated


                                                                     No
                                                                                                               Questionnair
                   Provincial                                                                                  es sent back
                   office                                                                     Filled           to provincial
                   receives                Provincial office                                  questionnaires   office for
                                                                   Quality          Yes
                   material                verifies quality of                                sent to head     verification
                                                                   accepta
                   back from               questionnaires                                     office
                                                                   ble
                   regional
                   office                                                                                          No

                                                                                              Head office
                                                                                              receives                                  Head office
                                                                                              material and       Quality                processes
                                                                                              verifies                            Yes   payment
                                                                                                                 accepta
                                                                                              quality of         ble                    advices
                                                                                              questionnair
                                                                                              es
                                                                                                                                        Payment
                                                                                                                                        advices are
                                                                                                                                        sent to HR
                                                                                                                                        for
                                                                                                                                        appointment


                                                                                                               Fieldworkers are
                                                                                                               appointed and            HR receives
                                                                                                               payment advices          payment
                                                                                                               sent to Finance          advices



                                                                                    Payment of
                                                                                    fieldworkers through
                                                                                    persal and bank            Finance receives
                                                                                    accounts                   payment advices
                                     Sixth Process
                                     Processing


Processing       Questionnaires    Data is sent                          Weights
center at head   are coded,        for weighting                         adjusted
office receive   scanned, and
questionnaires   edited – stored
                 in database                                                    No


                                   Weighting                                                          Weights
                                   official        Weights are            Weights                     sent for
                                   receives        calculated             acceptable          Yes     tabulation
                                   data


                                                                                                      Tabulation              Data
                                                                                                      officer       Tables    sent for
                                                                                                      receives      design    report
                                                                                                      data          ed        writing


                                                                                                                    Final     Data
                                                                                       Final          Statistical   report    sets
                                                                 Process Ends          product sent   release       written   received
                                                                                       to client
PLANNING OF THE NATIONAL HOUSEHOLD TRAVEL SURVEY

   •Design of the questionnaire
   •Testing and observational studies
   •Sampling
   •Field operations
   •Processing
   •Challenges
   •Comments and suggestions
PLANNING OF THE NATIONAL HOUSEHOLD TRAVEL SURVEY
DESIGN OF THE QUESTIONNAIRE

Stakeholders consulted:
•National Department of Transport
•TRC Africa Consortium
•Statistics South Africa
•External users – National Treasury
•International consultants – Peter Jones
•Advisory Committee
STRUCTURE OF THE QUESTIONNAIRE

•   COVER – COVERING INFO ON PSU AND SAMPLED DWELLING UNITS
•   FLAP – STRUCTURE OF THE SAMPLED HOUSEHOLD

    SECTIONS ON:
•   DEMOGRAPHIC INFORMATION – AGE , GENDER, RACE
•   LEVELS OF EDUCATION
•   ACCESS TO FACILITIES
•   EMPLOYMENT AND UNEMPLOYMENT
•   MODES OF TRANSPORT
•   SCREENING QUESTIONS FOR WORKERS
•   INDIVIDUAL TRANSPORT QUESTIONS FOR WORKERS
PLANNING OF THE NATIONAL HOUSEHOLD TRAVEL SURVEY
TESTING AND OBSERVATIONAL STUDIES

•Intensive Behind the Glass Testing of the questionnaire
          12 sessions
•Pilot Survey 1
          Gauteng 2003
•Pilot Survey 2
          Mpumalanga 2003
PLANNING OF THE NATIONAL HOUSEHOLD TRAVEL SURVEY
SAMPLING FOR THE NTS

Step 1
•Overlap the 342 Travel Analysis Zone (TAZ) boundaries with the Census 2001 EA
frame

Step 2
Determine the number of EAs to be allocated to each of the TAZ’s. Need to use the
number of dwelling units in the EAs as a measure of size. The power allocation
method was used to determine the number of PSUs to be allocated per TAZ.

Step 3:
Creation of PSUs.
The PSU number consists of 12 digits, this was done by Geography. The first 8 digits
represent the EA number and the last 4 digits represent the number of the PSU.
 For example:
124700120001 = Western Cape, PSU number 01
PLANNING OF THE NATIONAL HOUSEHOLD TRAVEL SURVEY
SAMPLING FOR THE NTS, continued

Step 4:
Pooling EAs – Additional EAs were pooled to form PSUs if the selection criterion which a minimum
of 80 dwelling units in an EA, where EA type and Area type must be the same as the original EA. If
the original EA drawn was found to have too few dwelling units then the modified method of Kish’s
pooling of EAs was to be used.

Step 5:
Determining the methodology for selecting dwelling units in the selected PSU.
Once the 09 books had been copied, these were verified in the field during publicity PPS systematic
sampling of EAs was used in all cases and equal probability systematic sampling was used to
select the dwelling units that would be enumerated in each drawn EA. This allowed for approximate
self-weighting of the selected dwelling units within each of the TAZ’s.

Step 6:
One person (aged 15 years and older) in each household at each of the selected dwellings was
selected for enumeration in Section 7 (attitudes to transport services) in the questionnaire. Kish’s
grid for selection of individuals in the household aged 15 years and older was used to determine
who will be required to complete the attitudes to transport services.
THE SAMPLE ALLOCATION TO EACH PROVINCE BY EA TYPE

PROVINCE   FARM   HOST   IND   INF   SMHO   TRI    URB    TOTAL


WC         56     10     2     27    6      -      467    575

NW         56     20     5     3     2      147    149    382

LP         29     2      3     5     4      319    74     448

NC         30     -      -     6     7      11     120    174

MP         44     3      2     25    2      101    156    355

KZN        70     9      2     75    8      385    397    946

GP         19     55     6     124   26     2      702    934

FS         64     15     5     23    3      26     277    413

EC         37     1      -     45    4      449    278    814

TOTAL      405    115    25    333   62     1440   2620   5000
PLANNING OF THE NATIONAL HOUSEHOLD TRAVEL SURVEY
FIELD OPERATIONS

The following personnel / Staff nationwide were used:

9       Provincial Survey Manager
30      Regional Survey Managers
95      Assistant Regional Survey Managers
9       Survey Clerks
1026    Fieldworkers
295     Supervisors
35      Data Capturers
PLANNING OF THE NATIONAL HOUSEHOLD TRAVEL SURVEY
FIELD OPERATIONS – STAFF EMPLOYED

                                               Survey                                         Total
    Province     PSUs   Field-workers   PSMs            Supervisors
                                                Clerk                 A/RSMs   GIS officers   Staff

Western Cape     568         95          1       1          36          11                    144

Eastern Cape     814        168          1       1          47          31                    248


Northern Cape    174         50          1       1          13          5                      70


Free State       413         80          1       1          20          8           4         114


Kwa Zulu Natal   946        174          1       1          58          16          3         253


North West       413         81          1       1          21          11          5         120


Gauteng          903        204          1       1          51          20                    277


Mpumalanga       333         83          1       1          21          9           3         118


Limpopo          436         91          1       1          28          14                    135


TOTAL            5000       1026         9       9         295         125         15         1479
PLANNING OF THE NATIONAL HOUSEHOLD TRAVEL SURVEY
FIELD OPERATIONS – VEHICLES USED

  Province            GG Vehicles   Hired Vehicles   TOTAL


  1. Western Cape             24              30             54

  2. Eastern Cape             20              47             67

  3. Northern Cape            13              6              19

  4. Free State               12              26             38

  5. Kwa Zulu Natal           13              62             75

  6. North West               13              16             29

  7. Gauteng                  17              58             75

  8. Mpumalanga               18              10             28

  9. Limpopo                  12              24             36

  TOTAL                       142            260             421
PLANNING OF THE NATIONAL HOUSEHOLD TRAVEL SURVEY
FIELD OPERATIONS – MATERIAL ALLOCATIONS PER FIELD TEAM

Materials Per Team
•Interviewer’s manuals
•Supervisor’s manuals
•Administrative Manuals
•Questionnaires
•List of PSUs allocated to Team
•Copies of numbered 09 listings of the PSUs allocated to the Team
•Maps of the selected EAs
•ID cards
•Introduction letter
•Posters
•Pencils/ pens
•Erasers
•Sharpeners
•Log Book
PLANNING OF THE NATIONAL HOUSEHOLD TRAVEL SURVEY
FIELD OPERATIONS – TRAINING

TRAINING WAS CASCADED TO 3 LEVELS –

1. NATIONAL TRAINING (TRAINING OF THE TRAINERS – CORE TEAM)
    • WHICH WAS ATTENDED BY THE CORE PROVINCIAL STAFF

2. PROVINCIAL TRAINING
    • WHICH WAS COORDINATED BY THE CORE PROVINCIAL TEAM

3. REGIONAL TRAINING (TRAINING OF THE FIELDWORKERS)
    • WHICH WAS COORDINATED BY THE ASSISTANT REGIONAL MANAGERS



MAP TRAINING PLAYED A CRUCIAL ROLE IN ALL LEVELS OF TRAINING
     PLANNING OF THE NATIONAL HOUSEHOLD TRAVEL SURVEY
     FIELD OPERATIONS – DATA COLLECTION

•    Initial data for the project was collected from 25 May to the 20 June 2003

       • On 2nd September 2003, a delegation from the NDOT met with Stats SA to
      discuss the status of response rates per Travel Analysis Zone. At this meeting a
      joint decision was taken by Stats SA and the NDOT with regards to the TAZ’s:
1.     Travel Analysis Zones that were considered small, i.e. having 9 and/or fewer PSU’s
        would require a TAZ response rate of not less than 90 %
2.     Travel Analysis Zones that were considered large, i.e. having 10 and/or more PSU’s
        would require a TAZ response rate of not less than 85 %

With consultation with sampling experts at Stats SA, it was agreed that fieldwork take place in
4 TAZ's that did not meet the above criteria:

      •   Western Cape: 9002,
      •   Mpumalanga: 5007 and 5015
      •   Limpopo: 7001
      •   In total 56 PSUs would be enumerated
      •   Fieldwork: 20 November – 3 December 2003
Reconciliation response rates

               TAZ affected   Total number of PSUs   Response rate (RC 1)
Province                      redone

Western Cape   9002           11                     96

Mpumalanga     5007           12                     98
               5015           17                     100

Limpopo        7001           8                      87

Total          4              56                     95.25
CONSOLIDATED RESPONSE RATE
              RC0        RC1      RC2        RC3        RC4        RC5        RC6     RC7        RC8        RC9        Total

  WC      N         11    4916      218        226            9          0      155         74     228            5      5842

          %    0.19       84.15    3.73       3.87       0.15       0.00       2.65    1.27       3.90       0.09      100.00

  EC      N         24    7265      344            43         7          3      516         43     249            15     8509

          %    0.28       85.38    4.04       0.51       0.08       0.04       6.06    0.51       2.93       0.18      100.00

  NC      N         6     1564          12         4          2          0      156         19         34         0      1797

          %    0.33       87.03    0.67       0.22       0.11       0.00       8.68    1.06       1.89       0.00      100.00

  FS      N         12    3552          92         54         7          1      323         55     118            2      4216

          %    0.28       84.25    2.18       1.28       0.17       0.02       7.66    1.30       2.80       0.05      100.00

 KZN      N         7     9111      133        165            9          1      348     136        137            5     10052

          %    0.07       90.64    1.32       1.64       0.09       0.01       3.46    1.35       1.36       0.05      100.00

  NW      N         17    3433          67         40         5          1      226         40         48         1      3878

          %    0.44       88.53    1.73       1.03       0.13       0.03       5.83    1.03       1.24       0.03      100.00

  GP      N         7     8112      497        555            39         3      194     217        154            16     9794

          %    0.07       82.83    5.07       5.67       0.40       0.03       1.98    2.22       1.57       0.16      100.00

 MPU      N         7     2889          91         91         5          1      194         21         65         2      3366

          %    0.21       85.83    2.70       2.70       0.15       0.03       5.76    0.62       1.93       0.06      100.00

Limpopo   N         24    3986          70         40         7          1      288         45         63         2      4526

          %    0.53       88.07    1.55       0.88       0.15       0.02       6.36    0.99       1.39       0.04      100.00

 RSA      N     115      44828     1524       1218            90         11    2400     650       1096            48    51980

          %    0.22       86.24    2.93       2.34       0.17       0.02       4.62    1.25       2.11       0.09         100
PROCESSING OF THE NATIONAL TRAVEL SURVEY 2003

1.       Development of programs.
     •      Capturing
     •      Scanning
     •      Editing

2.       Receiving of boxes from the field.
     •      Field ops checks all material arriving from the provinces

3.       Boxes are handed over to processing.

4.       Checking of enumerated sample.

5.       Quality checking of questionnaires.

6.       Coding of questionnaires.
PROCESSING OF THE NATIONAL TRAVEL SURVEY 2003, continued

•     Cutting of questionnaires.

8.    Scanning.

9.    Capturing.

10.   Editing of data.

11.   Reducing of Scanned data.
MIS and Project Coordination
Documents issued and completed using Project Management

•   Contract with National Department of Transport
•   Business Plan and Detailed Budget
•   Project Organisation Chart
•   Project stakeholder list
•   Project registration form with the Office of Programme Coordination and
    MIS
•   Project kick-off meeting
•   Project brief/overview
•   Project scope of work statement
•   Project Work breakdown structure (WBS)
•   Project risk log
•   Project risk management form
•   Project key stage and sub-project responsibility chart
    Future recommendations:

•   If a project of this magnitude is to be undertake by the NDOT in conjunction
    with Stats SA the following points should be considered:
•   More time should be spent on the planning.
•   The manual needs clearer concepts and definitions that give more
    examples.
•   There should be training given to fieldworkers on how to sketch a map and
    what is needed on this map, if the Census 2001 09 Books are to be used .
•   A workshop held over a few days that involves the Provincial Survey
    Managers and other staff involved in the project should be organised.
•   The reporting forms for the monitors/quality assurers must be simpler so
    they can fill in all details in the field.
•   RSMs should have separated forms as they used the monitors reporting
    forms and completed them once the project had ended and forwarded them
    to Head office.
•   Trainer training as well as provincial training should be held most of the time
    in the field. Only concepts definitions and the questionnaire should be done
    in a training venue.
•   More evaluation exercises should be done during training after different
    modules such as concepts and definitions and then how to answer different
    sections within the questionnaire.
•   PSU maps must be supplied by provincial training as a complete set instead
    of having a few coming at a time.
•   Provinces should be given more time to check the questionnaires after field
    operations.
•   QAs should remain in the provinces a week later to do control checks with
    the listings.
•   It is very important that collaboration with various divisions in Statistics
    South Africa work together on this project. The collaboration with geography
    almost did not work well at all.
•   The following persons should be involved in the project from first inception
    through to the end: Quality and Methodology staff, Prof. Stoker and
    Geography staff, external experts could assist in giving an objective point of
    view.
•   ASD Finance in all provinces must sign all documentation relating to finance
    including the operational plans
•   A form monitoring mileage of vehicles must be improved on.

				
DOCUMENT INFO
Shared By:
Categories:
Tags:
Stats:
views:0
posted:9/17/2012
language:Unknown
pages:28