; Monitoring and Evaluation
Documents
Resources
Learning Center
Upload
Plans & pricing Sign in
Sign Out
Your Federal Quarterly Tax Payments are due April 15th Get Help Now >>

Monitoring and Evaluation

VIEWS: 11 PAGES: 27

  • pg 1
									Data Management in IPDs
  Issues and Challenges

 Country Communication Review
      28th - 29thJune 2007
                   Overview
•   Development of Data Tools
•   IPDs Data Tools
•   Data Collection
•   Sample Forms
•   Monitoring Process
•   Data Flow
•   Sample Output/Analysis
•   Additional Sources of Communication Data
•   Key Issues
•   Challenges
•   Way Forward
•   Question for the TAG
  Development of Data Tools
• M&EWG develops data tools in
  consultation with other Working Groups
• Draft tools are shared with Core Group for
  approval
• Approved tools are printed sent to
  states/LGAs
• Electronic database created/revised to
  incorporate new indicators
           IPDs Data Tools
• Pre-implementation Forms
  – Preimplementation Checklists
  – Community Dialogue Summary
• Implementation Forms
  – Fixed Post/H2H Tally Sheets
  – Non-compliance/Redo Forms
• In-process & End-process Monitoring Forms
  – Household Monitoring Form
  – Outside the Household Monitoring Form
            Data Collection
• Pre-implementation Checklist – Senior
  Supervisors
• Community Dialogue Checklist – LGA Health
  Education Officer
• IPDs Implementation Supervision Checklist –
  Senior Supervisors
• Tally and Redo-NC Sheets – Recorders in
  Fixed Posts/House-to-House Teams
• End-Process Monitoring Forms –
  Independent Monitors and Senior
  Supervisors
Sample Forms
                                                     LGA SUMMARY OF COMMUNITY DIALOGUES
      STATE………………………………                      LGA……………………………                                                                                                        IPD SM-2 Rev. 30 Oct 06


                                                                                                                                       ISSUES RAISED




                                                                                                                                                                      DECISIONS ARRIVED
                                                                                                       NO. IN ATTENDANCE
                                                                    NO. OF SESSIONS




                                                                                      TYPE OF GROUP*




                                                                                                                                                                                          ENDORSEMENTS
                                                      DISTRIBUTED
                                                      MATERIALS




                                                                                                                                                                      AT
S/N   WARD     COMMUNITY         MODERATOR   VENUE                                                                         1   2   3      4     5      6   7   8




      * Mixed, Male, Female or Youth
                                                    OPV TALLY SHEET FOR FIXED POSTS
                                                            Use a separate tally sheet each day
                                                                                                                   IPD T-1FP Rev. 30 Oct 06

State: ________________ LGA: ___________________________ Ward: ___________________                Date: ________________
Fixed Post:____________________________                         Settlement:____________________________
Vaccination Team Code: ______________                       Recorder Name: _______________________________________________

                                                                                                                           Sub-Total

                                            00000   00000        00000                 00000         00000

  (receiving OPV 1st time)
                                            00000   00000        00000                 00000         00000
                                            00000   00000        00000                 00000         00000
     OPV ZERO DOSE
                                            00000   00000        00000                 00000         00000
                                            00000   00000        00000                 00000         00000
                                            00000   00000        00000                 00000         00000
                                            00000   00000        00000                 00000         00000
                                            00000   00000        00000                 00000         00000
                                            00000   00000        00000                 00000         00000
                                            00000   00000        00000                 00000         00000
                                            00000   00000        00000                 00000         00000
                                            00000   00000        00000                 00000         00000
                                            00000   00000        00000                 00000         00000
                                            00000   00000        00000                 00000         00000
                                            00000   00000        00000                 00000         00000
                                            00000   00000        00000                 00000         00000
                                                                                                   Sub Total
                                            00000   00000        00000                 00000          00000
                                            00000   00000        00000                 00000          00000
                                            00000   00000        00000                 00000          00000
                                            00000   00000        00000                 00000          00000
                                            00000   00000        00000                 00000          00000
  OTHER OPV DOSES




                                            00000   00000        00000                 00000          00000
                    (received OPV before)




                                            00000   00000        00000                 00000          00000
                                            00000   00000        00000                 00000          00000
                                            00000   00000        00000                 00000          00000
                                            00000   00000        00000                 00000          00000
                                            00000   00000        00000                 00000          00000
                                            00000   00000        00000                 00000          00000
                                            00000   00000        00000                 00000          00000
                                            00000   00000        00000                 00000          00000
                                            00000   00000        00000                 00000          00000
                                            00000   00000        00000                 00000          00000
                                            00000   00000        00000                 00000          00000
                                            00000   00000        00000                 00000          00000
                                            00000   00000        00000                 00000          00000
                                            00000   00000        00000                 00000          00000
                                            00000   00000        00000                 00000          00000
                                  OPV TALLY SHEET FOR HOUSE-TO-HOUSE
                                               Use a separate tally sheet each day                      IPD T-1HH Rev. 30 Oct 06


State: ________________ LGA:____________________ Ward: ___________________              Date:_______________
Settlement: ________________________
Vaccination Team Code: ______________            Recorder Name: _______________________________________________

                                                                                                               Sub-Total

                               00000   00000          00000                  00000       00000




                *ZERO
                 DOSE
                               00000   00000          00000                  00000       00000
                               00000   00000          00000                  00000       00000



 HOUSEHOLDS
                               00000   00000          00000                  00000       00000
                               00000   00000          00000                  00000       00000
                               00000   00000          00000                  00000       00000

                 OTHER DOSES
                               00000   00000          00000                  00000       00000
                               00000   00000          00000                  00000       00000
                               00000   00000          00000                  00000       00000
                               00000   00000          00000                  00000       00000
                               00000   00000          00000                  00000       00000
                               00000   00000          00000                  00000       00000
                               00000   00000          00000                  00000       00000
                *ZERO
                 DOSE




                               00000   00000          00000                  00000       00000
                               00000   00000          00000                  00000       00000
                               00000   00000          00000                  00000       00000
 SCHOOLS




                               00000   00000          00000                  00000       00000
                               00000   00000          00000                  00000       00000
                 OTHER DOSES




                               00000   00000          00000                  00000       00000
                               00000   00000          00000                  00000       00000
                               00000   00000          00000                  00000       00000
                               00000   00000          00000                  00000       00000
                               00000   00000          00000                  00000       00000
                               00000   00000          00000                  00000       00000
                               00000   00000          00000                  00000       00000
                *ZERO
                 DOSE




                               00000   00000          00000                  00000       00000
                               00000   00000          00000                  00000       00000
 OTHER PLACES




                               00000   00000          00000                  00000       00000
                               00000   00000          00000                  00000       00000
                               00000   00000          00000                  00000       00000
                 OTHER DOSES




                               00000   00000          00000                  00000       00000
                               00000   00000          00000                  00000       00000
                               00000   00000          00000                  00000       00000
                               00000   00000          00000                  00000       00000
                               00000   00000          00000                  00000       00000
                               00000   00000          00000                  00000       00000
                                                                                       Total

                                       00000          00000                  00000       00000
      NON-COMPLIANT                    00000          00000                  00000       00000
       HOUSEHOLDS                      00000          00000                  00000       00000
                                       00000          00000                  00000       00000
                                                                                       Total
                                                  IPDs Form for NON-COMPLIANCE / REDO
                                                        (To be reverse of the House-to-House Tally Sheet)
Dates of Implementation :__________________________                     IPD Catchment Area:__________________________                         IPD NC-1 Rev. 30 Oct 06

WARD:_________________LGA:_________________ STATE:___________________                   DATE:_____________
Revisit should be carried out by Ward Focal Person/Vaccination Team Supervisor on the same/next day and reported in Action Taken
                                                    IPDs House-to-House Vaccination Team Activity                                                           ACTION TAKEN

                                                                             No. of      Reason for Missed Children       Reason for                         No. of Children No.of Children
                                                                        Children 0-59                                   Non-compliance         Revisited?
      Settlement      Name of Head of household     Location / Street                                                                                         0-59 months     0-59 months
                                                                        months Missed                                   (Write Code No. for     Yes/No
                                                                                                                                                               Immunized     not Immunized
                                                                         in Household                                    reason as below)

                                                                                        Child Absent   Non-compliance
          (A)                    (B)                       (C)                (D)           (E1)            (E2)                (F)               (G)              (H)            (I)]




TOTAL
                                                    NIGERIA IPDS: HOUSEHOLD MONITORING FORM
                                                             IN / END PROCESS                                                                                           IPD M-1 Rev. Oct 06
              In Process                    End Process

                                                          (This Form should be filled by State Team, Independent & Agencies' Staff Monitors)


NOTE: fill out one form for each settlement monitored. Select at least one of the settlements in the ward and visit at least ten (10) randomly selected households.

Settlement:__________________________                   Ward:_______________________                  LGA:_________________                    State:____________

                                            Vaccination Team Supervisors Name ________________________ Vaccination Team Code ___________
  House          Was the     No. of Children                               No. of Children    No. of          No. of      No. of Children                                                    Source of        Who influences
 Number         Household    Physically Seen                                Vaccinated at    Children        children    Unvaccinated this       Reasons for Unvaccinated Children         Information       Your Decision to
                                               No. of Children Confrmed                                                                            (Indicate Number of Children)
                Visited by        in the               Immunized             Fixed Posts   Vaccinated in   immunized          Round                                                      (Insert codes as     Vaccinate your
               Vaccination     Household     Seen Marked Recorded on                        House-to-      for the first                                                                    key below)       Children? (Insert
               Team? (Y/N)                     with Pen      Vaccination                      House           time?                                                                                         codes as key below)
                                                                                                                                             Household not
                                               Marker           Card                                                                                       Child Absent Non-compliance
                                                                                                                                                Visited

        (A)         (B)            (C)            (D)            (E)             (F)            (G)            (H)              (I)               (J)           (K)            (L)             (M)                    (N)


        1

        2

        3

        4

        5

        6

        7

        8

        9

        10

Total


Any comments (e.g. did you find pockets of unimmunized children or houses not visited? Describe): ________________________________________________

___________________________________________________________________________________________________________________________________________________________________                       (continue on back of the form)



MONITOR'S NAME:___________________________ AGENCY/ORGANIZATION____________ SIGNATURE: ______________ DATE: ____________


CODES:
Source of Information (all that apply): 1 = Town Crier; 2 = Media (Radio or TV) ; 3 = Traditional/Religious Institutions ; 4 = Neighbour, Friend; 5 = Other sources; 6=Not aware of campaign.

Who Influences Decision To Vaccinate (all that apply): 1 = Personal Decision; 2 = Husband; 3 = Traditional Leader; 4 = Religious Leader; 5 = Radio or TV; 6 = Neighbour, Friend;
         7 = Health Worker; 8 = Others________________

NOTE: give original after daily activity to LGA STF or National/External Consultant. Keep a copy for yourself.
                                                                                                                                                                     OM-1


                               OUTSIDE THE HOUSEHOLDS MONITORING, NIGERIA IPDs
                                                                                                                                                                 Rev 9 Jan 2007
                                                                NIGERIA IPDs :            IN PROCESS                    END PROCESS


(This Form should be filled by State Team, Independent & Agencies' Staff Monitors)


NOTE: Fill out one form for each settlement monitored. Select at least one of the settlements in the ward and visit places outside households such as Markets, Motor park, Schools, Streets, Places
of worship. Monitor at least 20 eligible children in Streets, visit at least 2 Koranic Schools and sample at least 20 children in each school, and finally 20 children in other locations.


Settlement:_______________________Ward:____________________LGA:__________________State:_______________

Date vaccination team visited:______________________

Vaccination Team Supervisor's Name __________________________________Vaccination Team Code ________________


 S/N
                    Location                   No. of eligible children sampled in       No. of children seen marked with pen
                                                                                                                                             Number of children unvaccinated this round
                 (see key below )                            location                                    marker
                         (A)                                      (B)                                         (C)                                                   (D) = B - C


   1

   2

   3

   4


   5

   6

   7

   8


   9

  10

 Total
  %
                                                                                                          C/B X 100 %                                             D/B X 100 %



MONITOR'S NAME:____________________________ AGENCY/ORGANIZATION________________ SIGNATURE: ___________________ DATE: ____________________


KEY:     LOCATION
         Street = S
         Koranic School = KS
         Nursery School = NS
         Market = M
         Playground = P
         Others = O (Specify e.g. Mosque, Church, Hospital, Motorpark)
Monitoring Process
         TOR of Monitors
• Work closely with LGA team
• Conduct end-process monitoring in 60
  households with under-5 children per day
• End-process should be done for 2 days
  after completion of implementation
• Submit end-process data to LGA team and
  share with State team
• Sample households in 2 Wards each
      Selection of Monitors
• Mature, responsible person involved in
  providing social services e.g. teacher,
  retired health worker, college graduate
• Should preferably be female
• Should be able to speak the local language
• Should be culturally sensitive
• Should have knowledge of immunization
  programme
• Should be energetic and able to walk long
  distances
       Training of Monitors
• NPHCDA and Agency Monitors are trained
  at state and national levels
• Independent Monitors are trained at the
  LGA
• Training focuses on understanding the
  monitoring tools, sampling houses and
  conducting household interviews
• The best 4 IMs are selected after training
  at the LGA
                     Data Flow
Preimplementation/
Community Dialogue             Tally/                  End-process
    Checklists                Redo-NC                Monitoring Forms




                          Ward Summary
                        (Ward Focal Person)



                            LGA Summary
                     (State Technical Facilitator)




                           State Database




                         National Database



                              Working
                              Groups
Sample Output/Analysis
               Reasons for Missed Children –
                Monitoring Data, March 2007
                       90

                       80                                     House not visited
                                                              Child Absent
                       70                                     Non-compliance
% of Missed Children




                       60

                       50

                       40

                       30

                       20

                       10

                       0
                            Bauchi   Jigawa   Kaduna   Kano   Katsina   Zamfara
Sources of Information – Monitoring Data,
               March 2007
                      Town Crier                              Radio or TV
                      Traditional/ Religious Institutions     Neighbour, Friend
                      Other Sources                           Not Aware of Campaign
                  100%
                   90%
                   80%
                   70%
 % of responses




                   60%
                   50%
                   40%
                   30%
                   20%
                   10%
                    0%
                             Kano       Katsina      Jigawa   Bauchi     Kaduna       Zamfara
Reasons for Non-compliance in 6
 VH/HR States – NC/Redo Data
       Reason Not Given

       Too Many Rounds

Unhappy With Vaccinators

   No Caregiver Consent

      Political Differences

            No Need Felt

          Religious Belief

                Child Sick

              OPV Safety

                              0   5   10       15   20   25
                                           %
        Additional Sources of
        Communication Data
• Data from additional tools employed by
  Partners in Social Mobilization
• Third party studies
  – NPI KAP study on Polio Immunization
  – Rapid Assessment of Social
    Mobilization
              Key Issues
• Quality of data management at state level
• Capacity for analysis of communication
  data at state level
• Inadequate personnel dedicated to
  collecting communication data at the LGA
  and community levels
• Need for greater involvement of MEWG in
  the development tools by different partners
             Challenges
• Weak capacity of vaccination team
  personnel to properly use tools
• Weak database management capacity at
  states
• Weak capacity for data analysis at LGA
  level
• Data falsification at team/LGA levels
• Frequent revisions to data tools and
  collection process
           Way Forward
• Review the training and selection of
  recorders in vaccination teams
• Capacity building in data management and
  data quality checks for state personnel
• Improve support by states to LGAs in
  relation to data analysis and planning
      Question for the TAG
• How can the collection and analysis of
  data at the LGA level be strengthened to
  ensure that planning of communication
  interventions is data-driven?
Thank You

								
To top