Utilization of the Logframe OVIs by hcj

VIEWS: 28 PAGES: 70

									Retrieval and
Utilization of the Logframe OVIs
for Results Based Management




        The Philippine Approach




              United Nations Population Fund
              Manila Country Office
              February 2002
Retrieval and
Utilization of the Logframe OVIs
for Results Based Management




The Philippine Approach




       United Nations Population Fund
       Manila Country Office
       February 2002
Glossary



CO         Country Office

CP         Country Programme

CPA        Country Population Assessment

IEC        Information, Education and Communication

LF         Log Frame

MIS        Management Information System

MOV        Means of Verification

PDS        Population and Development Strategy

QOC        Quality of Care

RBM        Results Based Management

RTI/STI    Reproductive Tract Infection
           Sexually Transmitted Infection

UNFPA      United Nations Population Fund

VSC        Voluntary Surgical Contraception
Part I.



Conceptual Framework
(Based on RBM Orientation Guidelines)




                                        1
Introduction

In 1997, UNFPA in its programming process shifted towards results based management
(RBM) using the logical framework objectively verifiable indicators (OVIs). The policy
states that:

          “RBM is fundamental to the Fund’s approach and practice in fulfilling its mandate
          and effectively providing assistance to developing countries.             UNFPA will
          systematically focus on results to ensure that its resources are strategically deployed
          to achieve the greatest impact … and contribute to enhancing a culture of
          accountability, learning and achieving results1 …….”

RBM focuses on the identification of measurable changes (results), monitoring progress
regularly and adjusting the activities on targets as needed to ensure that the desired results are
achieved.


A.        Assessing the Results Chain

The review of programme performance is done through the logical framework matrix that
links the hierarchy of aims (goal, purpose, outputs and activities) through their corresponding
OVIs drawn from the specified sources known as the means of verification (MOVs). The
results chain (logframe matrix) is illustrated as follows:


                          Figure1:        The Results Chain (Logframe Matrix


                                                          Goal                                S
                      R                                                                       T
                      e                                                                       R
                                              Purpose              Purpose
                      s                                                                       A
                      u                                                                       T
                      l                                                                       E
                                Output           Output          Output        Output
                      t                                                                       G
                      s                                                                       I
                                                                                              E
                                                                                              S


                                                        Activities
                                                          Inputs




1
    UNFPA Results Based Management Orientation Workshop, January 2001

                                                                                                  2
   Outputs are the measurable changes that occur within a specific time and as a
    consequence of project or management activities (the term “deliverables” is also used).
    UNFPA is accountable for the Outputs it produces through all its programme and
    management activities. Outputs should contribute directly towards attaining the
    organization’s results.

   Purposes refer to the measurable changes that occur in behaviour, attitudes, commitment,
    or socio-cultural values of groups, as well as legal, institutional and societal practices, as
    a consequence of achieving the expected outputs. UNFPA, together with several
    partners, contributes to the attainment of purposes

   A Goal is defined as a basic condition of well-being for individuals, families and
    communities. It is the highest level of result to which UNFPA contributes, together with
    the efforts of other partners. There must be a logical connection among inputs, activities,
    outputs, purposes, and goals.


    How are results measured?

    Objectively verifiable Indicators (OVIs), defined at the planning stage, are the means
    used to assess progress towards results. Indicators also provide evidence to demonstrate
    the extent to which results have been achieved by the end of a programme or specific time
    period during implementation. Indicators may be either quantitative or qualitative.

    Quantitative indicators are statistical measures:

          Number of
          Frequency of
          % of
          Amount of
          Increase in

    Qualitative indicators are interpretative judgments:

          Enhanced
          Strengthened
          Extent of
          Degree of
          Congruence between




                                                                                                3
Figure 2 below shows RBM approach can be applied to all aspects of programme
planning and management.



              Figure 2:           Results-Based
                             Planning and Management


                                         Situation and problem analysis (CPA)
Strategic                                Formulate intended results and strategies (Logframe
Planning                                  Matrix OVIs)
                                         Select indicators (OVIs)
Performance                              Set baselines and targets (OVIs)
Monitoring                               Collect data on performance (MOVs) (Monitoring)
                                         Integrate monitoring and evaluation in system
                                         Analyze and report performance
Performance                              Use performance information for programme
Management                                modification and decision making




Why Monitor and Evaluate Performance?
To provide accurate and up-to-date information on progress:

Using OVIs

    to provide regular feedback and early indications of progress, or lack thereof;
    to track actual performance/situation against what was planned/expected.

For learning and decision-making:

      to detect early signs of potential problems and success areas;
      to take corrective actions:
      to improve the design and performance of ongoing programmes;
      to generate knowledge about what works and what does not work.

To improve accountability:

    to ensure that a programme/process continues to be relevant, and achieving results as
     intended;
    to make an overall judgment about the effectiveness of interventions.




                                                                                          4
   Key tools for Performance Monitoring

    For programmes – The Logical Framework (logframe) provides the basis for monitoring
    results. With the identification of persons/groups responsible for collecting data and the
    frequency of data collection for indicators determined, the logframe will guide staff and
    partners in collecting and analyzing data so that actual results can be compared with
    planned results. Monitoring should include an analysis of progress towards achieving the
    programme’s outputs (“deliverables”) as well as contribution towards achieving the
    purposes and goal. Information gathered through monitoring is discussed with
    stakeholders at various meetings such as sub-programme, programme and mid-term
    reviews.

   Reporting using the RBM approach involves:

     Describing the results expected for a specific period;
     Identifying the actual results achieved at a specific time point;
     Analyzing and explaining the difference between what was expected and what was
      actually achieved;
     Identifying any changes you plan to make in the next implementation or planning
      period in order to increase the likelihood that the expected results will be achieved.

Programme managers will refer to the logframe indicators when monitoring and evaluating
performance and preparing reports. Unit managers at Headquarters and in the field will refer
to their annual results-based office workplan when monitoring performance and preparing
reports.

Figure 3 below shows how planning, monitoring, evaluation and feedback are integral
parts of the process of managing for results.


                                 A Simple RBM Model

                       Regular Monitoring and Evaluation




              Planned                                                  Actual
         (Logframe OVIs)                                         (computed OVIs)
              Results
             Planning                        Implementation




             Regular Feedback and Adjustment




                                                                                            5
B.       Prerequisites for the Adequate Monitoring of Sub-
         programme and Country Programme Achievements

1.     Assessment of the specificity and relevance of the hierarchy of aims (goal, purpose,
outputs, activities) and the logic of their linkage.

2.      Clear identification of the objectively verifiable indicators (OVIs) and their
congruence to the statement of aims (goal, purpose, outputs). Assessment of their directness,
objectivity, practicality and adequacy at the specified levels.

3.      Assessment of the sources of the OVIs (means of verification (MOVs). Can they be
retrievable from the current information base? Or should new information sources be
established? What are the cost implications of the management information systems (MIS)?
Could they provide the needed data according to the specified time table?

4.      Ensure that each specified OVI has its corresponding means of verification. If rates
or ratios are involved, specify how numerators and denominators can be sourced.

5.      For each sub-programme logframe matrix, prepare the indicators’ checklist
particularly for the outputs.


Indicators checklist for Monitoring and Evaluation of Sub-programme

Output         OVIs         Specific       Source of     Responsible     Frequency of   Status
                            indicators     information   Agency          information
                            needed                                       retrieval

1.


2.


3.


4.




6.       Prepare reporting form to capture the indicators at each level of the reporting unit.

7.       Set up management information system (MIS) by identifying the:

         a)     various sources of information and means of retrieving/reporting them

         b)     compiling and consolidating the various data required for each output
                indicated. (Who will be responsible for collecting and consolidating the
                information at various level?) Who will be responsible for summarizing the
                information (including summary forms to be used)? Who will be responsible
                for the determination of percentages, rates, and ratios? Who will prepare the
                adequacy checklist for PDS and advocacy? Ensure validity/completion of the
                                                                                                 6
               information collected. It will be useful to prepare summary forms at the sub-
               provincial level.

       c)      Preparing flow-chart of data transmission with corresponding timetable.

8.     After validation and computation/determination of OVIs, enter information in the
logframe specifying time point in which information was drawn (from start of project).

9.      Compare the obtained results with those expected at the end of the project period. If
the obtained values exceeded the expected values:

       a)      how realistic are the expected values?
       b)      what factors catalyzed or constrained the achievement or progress towards
               targets?
       c)      are there specific subunits that performed better than the other?

If the obtained values are far below the expected results:

       a)      what factors accounted for the poor performance? Manpower? Risks and
               assumptions? Capacity? Logistics, etc. Are the baseline indicators realistic?

       b)      Are there subunits that performed poorly or worst? What accounted for this?
               How can the performance be improved?

       c)      Is the target realistic? Judging from the performance trend, with realistic
               modification, what could be a meaningful OVI?

10.    Analyze in-depth the external factors which interfere with programme implementation
and consider how they can be addressed at the project and sub-programme levels. Assess the
enabling factors (programmatic and external).

11.    Undertake a trend analysis of actual results at specific time points to assess rate of
change and proximity to intended results.


Identification of the OVIs

1.     Determine results elements which need clear cut definitions.

       Example:        Comprehensive
                       Integrated
                       Quality
                       Gender sensitive
                       RH services
                       Approved standards

2.     Define succinctly the various elements indicated in the OVIs.

3.     Indicate whether the OVIs call for percentages, ratios, and rates. If so each OVI,
determine the numerator and denominator. Indicate the raw data to be collected and their
sources (service forms, survey, etc.)

                                                                                            7
4.     Identify the data analysis to be undertaken. Should data analysis be centralized or
       devolved? What are the cost implications and standardization/validation concerns?
       How viable would the data collection procedure be?

5.     Determine the reports to be provided. Who will prepare the reports? What further
       information will be needed? A reporting outline will be useful that will focus on the:

              i)      description of the logframe results including convergence or short
                      falls;
              ii)     explanation for the observations; and
              iii)    planned modifications.


C.     Caveat

It is a misperception among implementers that the OVIs should only be used at the end of the
project implementation for the purpose of evaluation by an independent consultant.
Oftentimes, the project implementers are unclear about the OVIs while very familiar with
activities.

The project implementing agency is responsible for the collection of (from various sources),
analysis and reporting of all indicators mentioned in the logframe matrix for the outputs with
the aim of continuous monitoring of progress in the course of implementation.


D.     Pointers

1.      At the CO level, RBM encompasses a rigorous application of the logframe (LF)
approach in planning, monitoring and reporting of progress using the indicators identified in
the logframe matrix and learning from knowledge gained through monitoring and evaluation.
The challenge is to use the LF as a management tool through monitoring results and making
adjustments to the programme based on these findings to improve performance.

2.    Timeliness of data retrieval is crucial to the generation of the OVIs identified in the
LF matrix for the purpose of monitoring and evaluation.

3.     Sufficient qualified national staff should be in charge of monitoring the sub-
programme and projects. Availability of computer and statistical skill is required. A
programme management database is needed.

4.      The review of the logframe with the information provided requires a continuous,
internal, analytical, self assessment (by CO staff and national counterparts) using OVIs.

5.       An in-depth, explanation of the cause/effect relationships among various layers of
problems to be addressed by the CP, its sub-programmes and their component projects will
lay the foundation for the programme and its inherent assumptions including how the
activities will lead to the attainment of the planned goals – a link between means and ends.

6.     The logical connection between sub-programme OVIs and project activities should be
ensured by setting up a monitoring scheme to collect OVI data required to track achievement

                                                                                            8
of sub-programme outputs. The aims of the sub-programme to which the project activities
are contributing should be explained to implementers.

7.     Standardized monitoring and evaluation plans should be developed based on
logframes set up and the database.

In summary, the elements for sub-programme monitoring include:

      definition of output OVIs
      indication of source of information
      institutions and persons responsible for collecting and analyzing data on OVIs
      timing of data collection/transmission including compilation and processing to
       measure output achievement
      explanation of the findings and corrective actions to be taken

For the Sub-programme Logframe to be an effective management tool, the information in the
matrix should be updated regularly in the context of annual Sub-programme and Mid-term
Reviews.


Monitoring

Monitoring is an important, valuable exercise to ensure programme quality. In general,
monitoring should focus less on report writing and more on ensuring that the monitoring
process is of high quality and produces results, which can be used to take corrective action as
well as for continuous assessment of the achievement of planned aims. The body of the text
should emphasize the rationale for monitoring and give substantive information on the causes
and facilitating factors for achievement of OVIs while reporting procedures, formats and
formal requirements could be placed in an annex.

While focusing on activities, monitoring should keep in view the outputs to which the
particular project is contributing. Thus, the sub-programme logframe should serve as a frame
of reference for the project implementers in order to know the higher aims of the project.


Component Project Monitoring

Component projects are reviewed annually using the logframe OVI information. If, as stated,
the main input for the APR is the component project workplan, then this workplan should be
improved to make it complementary to the sub-programme logframe.

APR: In assessing if the workplan has been implemented as expected, it should report on
progress of the selected indicators and whether the project is contributing toward achieving
sub-programme outputs and purposes or, if at an early state of project implementation, it is
likely to do so. Reporting should focus both on the substantive and management aspects of
project implementation.




                                                                                             9
Revised Sub-programme Logframe Matrix

AIMS                            OVIs2                         MOVs                          TIMING OF DATA                RESPONSIBLE                RISKS AND
                                                                                            COLLECTION                    ENTITY                     ASSUMPTIONS
Goal: Repeat the goal           Repeat the goal OVIs as       Repeat the goal MOVs          Indicate the period           Indicate the institution   Indicate assumptions
as stated in the Country        stated in the Country         as stated in the Country      during which goal OVI         responsible for            made retarding the
Programme document              Programme document            Programme document            data is to be collected       collecting, analyzing      constraints
to which this Sub-                                                                                                        and reporting on the       opportunities and actual
programme contributes                                                                                                     goal OVIs.                 risks in the environment
                                                                                                                                                     external to the country
                                                                                                                                                     programme which can
                                                                                                                                                     influence (positively
                                                                                                                                                     and/or negatively)
                                                                                                                                                     attainment of goals.
Purpose: Repeat the             Repeat the purpose            Repeat the purpose            Indicate the period           Indicate the institution   Indicate assumptions
purpose stated in the           OVIs as stated in the         MOVs as stated in the         during which purpose          responsible for            made regarding the
Country Programme               Country Programme             Country Programme             OVI data is to be             collecting, analyzing      constraints and
Document to which this          document                      document                      collected.                    and reporting on the       opportunities, and
Sub-programme                                                                                                             purpose OVIs.              actual risks in the
contributes.                                                                                                                                         environment external to
                                                                                                                                                     the country programme
                                                                                                                                                     which can influence
                                                                                                                                                     (positively and/or
                                                                                                                                                     negatively) attainment
                                                                                                                                                     of purpose.




2
    It may be useful for internal monitoring purposes to establish periodic (for instance annual) progress targets for each OVI.


                                                                                                                                                                          10
AIMS                      OVIs2                      MOVs                        TIMING OF DATA            RESPONSIBLE                 RISKS AND
                                                                                 COLLECTION                ENTITY                      ASSUMPTIONS
Outputs

Output 1: State the       State the OVIs for         State the means             Indicate the period       Indicate the                Indicate assumptions
first output.             outputs.                   through which data on       (from – to) during        institution(s) and          made regarding the
                                                     the OVI will be             which OVI data is to be   person(s) responsible       constraints and
Output 2:                 Etc.                       collected, analyzed and     collected.                for collecting, analyzing   opportunities, and
                                                     reported on (i.e. survey,                             and reporting on the        actual risks in the
Etc.                                                 field monitoring visits,                              output OVIs.                external environment
                                                     document review,                                                                  which can influence
                                                     analysis of statistics,                                                           (positively and/or
                                                     etc.)                                                                             negatively) attainment
                                                                                                                                       of sub-programme
                                                                                                                                       outputs.
Activities

State the major activities, which implemented together constitute the strategy to attain sub-programme outputs. Indicate the name of the component project
under which particular activities belong as well as the executing and implementing agencies.




                                                                                                                                                             11
Sub-programme Review Meeting

It is essential to highlight that a high quality Sub-programme review can only be achieved if
the APRs are analytical and informative. Also, it should be emphasized that the sub-
programme review meeting is not an isolated event but serves the purpose of preparing for
the Annual Country Programme Review. Interface with the country programme as a whole
should therefore be highlighted at the sub-programme review meeting.

The main items should be: review of logframe with focus on major achievements as indicated
by the OVIs; major constraints encountered (for instance, data collection problems); changes
in the internal/external environment which may have changed the original assumptions and
constitutes new risks or opportunities; assessment of the effectiveness of capacity building
activities; collaboration with other donors and within the UNDG. It is important that the sub-
programme review meeting discuss progress in OVIs, showing achievements towards
reaching intended outputs as stated in the logframe. Each annual meeting should set
intermediate milestone OVIs to be achieved the following year. These milestones will allow
continuous assessment of final programme targets, and, if required, their adjustment.


Annual Country Review

This section should flag the issues, which at a minimum should be addressed. This includes a
review of progress in relation to the CP logframe matrix; synergies among different sub-
programmes; changes in the internal/external environment and the original risks/assumptions;
data collection constraints; progress in institutional capacity building progress in relation to
ICPD goals as indicated in the CP. Ideally, an updated CP logframe matrix should be
prepared as a result of the review. The update should reflect design changes, only, such as
new strategies; number of indicators used or new indicators; different sources of data for
indicators, etc. Original OVIs should not be adjusted just to reflect poor implementation (for
example, it is common practice in UNFPA to adjust financial implementation rates at year
end before rephrasing funds to the following year so as to increase, on paper, spending in
relation to allocations).

A database containing ICPD and other population indicators relevant for the particular
country and programme should be established as part of a data bank maintained and
continuously updated by Country Offices.


Mid-Term Programme Review

Definition and Purpose

The Definition and Purpose section should clearly outline the purpose of the MTR. Emphasis
is on the review of status of implementation of the UNFPA funded programme, achievements
in terms of expected outputs and movement towards expected purposes and goals. The text
should convey that the MTR is an analytical and participatory exercise.




                                                                                             12
The MTR would address the following monitoring and evaluation aspects:

       assess to what degree programme aims are being met as per logframe matrix;
       assess quality, comprehensiveness, and utility of data generated during regular
        programme/project monitoring;
       decide which programme aspects need better monitoring and discuss eventual need
        for changing output OVIs;
       identify those programme elements which should be assessed in-depth through
        evaluations (thematic, by component projects, by sub-programmes, or the CP as a
        whole) before new Country Programme formulation;
       decide what aspects of programme content need to be adjusted.


   MTR is an exercise conducted by the Government and UNFPA. It examines the status of
   programme performance (instead of “implementation’ – use results-oriented terminology)
   based on established outputs and whether the programme is likely to contribute to
   achievement of the planned purposes and goals. Changes in programme direction and
   duration (with or without additional funding) may be proposed if the environment has
   changed or constraints have been encountered or the programme as formulated was
   unrealistic. The MTR provides the occasion for revisiting and updating the Country
   Programme monitoring and evaluation plan and to propose a plan for initiating and
   conducting the CPA exercise. It also provides an opportunity to review complementary
   activities funded by the Government and other donors, to discuss gaps and overlaps in the
   national population and development programme and to identify changes to the UNFPA
   supported programme accordingly, if required.

   The approach to the retrieval and analysis of the sub-programme logframe retrieval
   involves the:

   a)     assessment of the congruence between the statement of output aims and their
          corresponding OVIs
   b)     identification of the data needs to retrieve the OVIs (actual numbers, percentages,
          etc.) and their sources (forms, service statistics, survey questionnaire, observation
          checklist)
   c)     preparation of approved/agreed standards checklists on service provision, technical
          competence, etc.
   d)     delineation of cut-off points to determine the numbers and percentages (SDPs,
          providers, NGOs, schools, etc.) meeting approved standards.




                                                                                            13
Part II. The Philippine Approach


Mechanism for Retrieval of Sub-programme
Logframe Output OVIs


   A.   Reproductive Health RH (RH)

   B.   Population and Development Strategies (PDS)

   C.   Advocacy




                                                      14
A. REPRODUCTIVE HEALTH
    SUB-PROGRAMME




                         15
                       Philippine RH Sub-programme 1999-2004

                   Output 1

Provision of quality and gender-sensitive core
RH services:
 FP
 Maternal Health
 RTI/STD/AIDS
 ARH


                   Output 2                                 Purposes of the RH Sub-
                                                                 programme
Ongoing pilot project in Nuvea Vizcaya
expanded to the whole province to cover all            To have contributed to the increased
                                                       utilization of:
                                                       a) integrated and quality reproductive
                   Output 3                                health services by women, men
                                                           and adolescents
Technical capacity of service providers at all         b) gender-sensitive RH information.
levels of the health delivery system including
the NGOs enhanced for the provision of core


                   Output 4

Improved knowledge and awareness among
men, women and adolescents in selected                                GOAL
provinces on family planning, prevention of
STDs, responsible parenthood, gender issues            To have contributed to improvements
                                                       in the quality of life of all Filipinos
                                                       through:
                   Output 5                            a) better reproductive health
                                                       b) the attainment of population
Institutional capacity (in government and NGO              outcomes that are in harmony with
sectors in the 9 selected provinces) in planning,          available resources and
implementation, management and monitoring                  environment conditions
of RH programme and IEC                                c) the reduction of poverty



                   Output 6

Improved access of adolescent and youth
reproductive health information, counseling
and services through establishment of pilot


                   Output 7

Community-based constellation of counseling
and referral services established for the
prevention and management of violence against
women (such as domestic violence, rape,
incest, forced prostitution) through an effective
collaboration between government and NGOs
in selected provinces

                                                                                     16
Basic Tabulation Requirements to Generate RH-SP Logframe Outputs


Output 1:

A.    Provision of quality and gender sensitive core RH services:     Family Planning,
      Maternal Health, RTI/STD-AIDS, ARH.


OVI   1a    At least 80% of BHS, RHUs providing the following services as a package
            according to approved standards: 5 reversible modern FP methods, MHC and
            assisted delivery, prevention and management of RTIs/STDs and prevention of
            HIV/AIDS; and IEC on RH including FP.


OVU 1b      At least 80% of referral hospitals providing the following RH services in
            accordance with approved standards: a) all reversible modern FP methods; b)
            MHC and assisted delivery; c) prevention and management of RTIs/STDs and
            prevention of HIV-AIDS; d) management of consequence and complications
            of abortion; e) emergency obstetric care; f) VSC; and g) IEC.




                                                                                     17
Tables 1a and b          Percentage of BHS, RHUs and Referral Hospital Providing Specified Care Services Based on Approved Standards
                         by Province (year)

                                                                      Provinces
SDP Type           Cagayan    Quirino       Nueva         Aklan       Antique       Capiz       Sultan    Cotabato   Maguindanao   Total
                                            Vizcaya                                             Kudarat
1. Hospitals

a. Number
                   No.    %   No.       %   No.       %   No.     %   No.       %   No.     %   No.   %   No.    %   No.   %       No.     %
b. With 7 core
services

c. With core
services meeting
approved
standards
2. RHU’s

a. Number
                   No.    %   No.       %   No.       %   No.     %   No.       %   No.     %   No.   %   No.    %   No.   %       No.     %
b. With 4 core
services

c. With core
services meeting
approved
standards
3. BHS

a. Number
b. With 4 core
services
c. With core
services meeting
approved
standards



                                                                                                                                           18
Procedure:

1.     For participating SDPs, obtain those providing core services (4 core services for BHS
       and RHUs, 7 for hospitals)


% of SDP                        No. of SDPs with core services
with core services              _______________ x 100                   (according to SDP level)

                                Total No. of SDPs


2.     Apply Q of C checklist to SDPs with core services and obtain scores. Determine cut-
       off point for QOC designating all those obtaining scores equal to or greater than cut-
       off point as meeting approved standards.

3.     Obtain % of BHS, RHUs and hospitals with core services meeting the QOC standards
       based on designated cut-off point.

4.     Compare the obtained percentage with the expected levels stated in the logframe
       OVIs:

       a)       Determine the factors accounting for the shortfall (training, facilities, logistics,
                etc.).
       b)       Examine variations by province and discuss factors accounting for the
                observation.
       c)       Propose modifications (target, programmes).

Forms to be used:

1.     Provincial reports on SDPs with expected core services

2.     Quality of Care Checklists

               Facilities checklist by SDP
               Observation checklist on technical competence, interpersonal relations and
                referrals by SDP


Determination of SDP Overall Score:

Sources Facilities checklist                       Score x .20
QOC Observation Checklist:
    Technical competence                          Score x   .20
    Information and choice                        Score x   .20
    Inter-personal relations                      Score x   .20
    Follow-up and referrals                       Score x   .20




                                                                                                  19
OVI 1c        All BHSs in pilot areas and all RHUs providing counseling and/or services to adolescents based on approved standards

                                                                Pilot Areas

Table 1c      Number and Percentage of BHS in Pilot Areas and RHUs Providing Counselling and/or Services to Adolescents Based on
              Approved Standards, (year)

      Counselling and/or SDPs
                                              A                 B                     C                    D                 E
      1. BHSs in Pilot Areas            No.       %       No.        %        No.           %        No.       %       No.       %
      a Number                                    100.0              100.0                  100.0              100.0             100.0
      b. Providing counselling alone
      c. Providing counselling
      according to approved standards
      d. Providing services alone
      e. Providing services according
      to approved standards
      f. Providing counselling and
      services
      g. Providing counselling and
      services according to approved
      standards
      2. RHUs                                                                       All RHUs
                                        No.       %       No.        %        No.          %         No.       %       No.       %
      a. Number                                   100.0              100.0                   100.0             100.0             100.0
      b. Providing counselling alone
      c. Providing counselling
      according to approved standards
      d. Providing services alone
      e. Providing services according
      to approved standards
      3. Number with counselling
      and services
      a. Providing counseling and
      services according to approved
      standards



                                                                                                                                     20
Procedure:

1.    For BHS in pilot areas and RHUs, obtain those:

      a)     providing counselling alone
      b)     providing services alone
      c)     providing counselling and services

2.    Apply Q of C checklist for counselling and services.

3.    Determine scores.

4.    Determine cut-off point. Assess number of BHSs and RHUs meeting approved
      standards in counselling and services.

5.    Categorize SDPs according to service and counselling provision, based on approved
      standards (below and above cut-off points).

6.    Enter the number of SDPs meeting approved standards (above cut-off points) and
      compare with expected numbers in logframe OVIs. Provide explanations for
      findings.

7.    Propose modifications, if needed.


Forms to be used:

1.    Pilot area reports on counselling and services by SDP (BHSs and RHUs)

2.    Q of C forms for facilities, technical competence, interpersonal relations (for services)

3.    Checklist for approved standards for counselling




                                                                                             21
OVI 1d        At least 1 NGO and/or 2 schools per province in pilot areas providing counselling and referrals to adolescents according to
              agreed standards.

Table 1d      Number of NGO and/or Schools per Province in Pilot Areas Providing Counselling and Referrals to Adolescents
              according to Agreed Standards (year)


      1. NGOS                                        A                        B                        C                          D
      a. Number                                No.         %           No.           %           No.         %           No.          %
      b. Providing counselling and referrals
      c. Providing counselling and referrals
      according to agreed standards
      2. Schools
      a. Number                                No.         %           No.           %           No.         %           No.          %
      b. Providing counselling and referrals
      c. Providing counselling and referrals
      according to agreed standards



Procedure:

1.    Determine total number of NGOs and schools in pilot areas.
2.    Determine number of NGOs and schools per province in pilot areas providing counselling and referrals (and as % of total).
3.    Determine number of those providing counselling and referrals according to agreed standards.
4.    Compare with stated OVI (at least 1 NGO and/or 2 schools per province) and provide explanations.
5.    Propose modifications .

Forms to be used:

1.    List of NGOs and schools in pilot areas
2.    List of NGOs and schools per province in pilot areas with adolescent counselling and referral
3.    Checklist of agreed standards for counselling and referrals




                                                                                                                                          22
 OVI      1e     At least 50% increase in the number of male clients availing of FP services at all levels of SDPs

 Table 1e        Percentage increase in number of FP male clients at all levels of SDPs by province (year)

Type of                   Cagayan                   Quirino                 Nueva Vizcaya                 Aklan                    Antique
SDP              Start   END/STP    %     Start    END/STP    %     Start     END/STP     %     Start    END/STP   %     Start    END/STP    %
                         A    E     I/D           A      E    I/D            A     E      I/D           A     E    I/D           A      E    I/D

BHS
No. of male FP
clients
(vasectomy and
condom)
RHU
No. of male FP
clients
Hospitals
No. of male FP
clients




                                                                                                                                               23
                             Capiz                          Cotabato                       Sultan Kudarat                Maguindanao                          TOTAL
                   Start    End/STP        %       Start    End/STP        %       Start      End/STP     %        Start  End/STP    %              Start     End/STP        %
Type of                    A     E         I/D             A     E         I/D              A      E      I/D      Start A      E    I/D                     A       E       I/D
SDP
BHS
No. of male FP
clients
(vasectomy and
condom)
BHS
No. of male FP
clients
(vasectomy and
condom)
Hospitals
No. of male FP
clients

   STP      -        Specified time point
   A        -        Actual : For the actual number enter number of male clients based on the service statistics
   E        -        Expected : For the expected, multiply the number of male clients at the start by 1.5
   D        -        Decrease
   I        -        Increase

   Procedure
   1.     From the client records (service statistics), obtain the number of male FP clients (condom and vasectomy) [new and continuing] in the first quarter of the start of the
          RH sub-programme.
   2.     Multiply the number by 1.5 to obtain the expected number of clients (new and continuing) at the end of the sub-programme period.
   3.     Obtain the actual number of clients based on service statistics. Compare with expected numbers.
   4.     Identify SDPs by province with shortfalls (expected exceeded actual numbers). Post explanations for the observations noted.
   5.     Identify areas where promotion of male contraceptive use needs to be enhanced.

   Form to be used:
   1.    Service statistics on male FP clients by SDP and province (1st quarter of SP inception and last quarter of implementation or specific time
         point




                                                                                                                                                                               24
OVI 1f             At least 80% of clients are satisfied with the following services by category of SDP: 1) FP, 2) MCH, 3) Prevention and
                   management of RTIs/STDs and 4) ARH counselling
Table 1f           Percentage of clients satisfied with specific services by type of SDP by province (year)

                           Cagayan         Quirino         Nueva Vizcaya       Aklan           Antique         Capiz        Sultan Kudarat       Cotabato         Maguindanao
   Type of SDP         a      b    c   a      b    c   a         b     c   a     b     c   a      b    c   a     b     c   a       b    c    a      b     c   a        b     c
   and Services
   Hospital
   1. FP
   2. MCH
   3. Prevention and
   Mgmt of
   RTI/STD
   4. ARH
   Counselling
   RHU
   1. FP
   2. MCH
   3. Prevention and
   Mgmt of
   RTI/STD
   4. ARH
   Counselling
   BHS
   1. FP
   2. MCH
   3. Prevention and
   Mgmt of
   RTI/STD
   4. ARH
   Counselling
   ARH
   Counselling
   1. FP
   2. MCH
   3. Prevention and
   Mgmt of
   RTI/STD
   4. ARH
   Counselling


         a – No. interviewed; b – No. satisfied; c - % satisfied




                                                                                                                                                                           25
Procedure:

1.       Refer to RH Q of C Survey according to specific service availed based on the
         logframe OVI.
2.       Obtain number of respondents who availed of the specific service.
3.       Obtain those who were satisfied with the specific service:
         a)      FP
         b)      MCH and assisted delivery
         c)      Prevention and management of STI/STD
         d)      ARH counselling

4.       Compare % with the expected 80% determine reasons for inability to achieve 80%
         (shortfall).
5.       Provide recommendations.

Form

Q of C survey for males, females and adolescents

Output 2

OVI2 Ongoing pilot project in Nueva Vizcaya expanded to the whole province to cover
     all elements

OVI2a

At least 75% of BHS, 85% RHUs providing the ff. RH services as package in accordance
with approved standards:

1.       Five reversible modern FP methods
2.       MCH and assisted delivery
3.       Prevention and management of RTIs/STDs and prevention of HIV/AIDS
4.       Prevention and management of abortion and its complications
5.       Identification and referrals of breast and RT cancers
6.       Identification and referrals for infertility
7.       Information, education and counselling on RH including FP


Percentage of BHSs and RHUs Providing Package of Services in Accordance with
Approved Standards, Nueva Vizcaya (year)

                                                 SDP
1.   BHS                                                        No.                 %
a.   Number                                                                             100.0
b.   Providing core services
c.   With core services meeting approved standards
2.   RHUs
a.   Number                                                                             100.0
b.   Providing core services
c.   With core services meeting approved standards



                                                                                          26
Procedure:

1.    List number of BHSs and RHUs in Nueva Vizcaya.
2.    List number of BHS and RHUs with core services (compute %).
3.    List number of BHS and RHUs with core services meeting approved standards based
      on Q and C checklist.
4.    Obtain % of BHS and RHUs with core services meeting approved standards.
5.    Compare with the expected percentage (75% for BHS and 85% for RHUs).

Forms required:

1.    Listing of BHS and RHUs
2.    Q of C checklist with specified cut-off point




                                                                                    27
OVI 2b            The Nueva Vizcaya Provincial Hospital and two District Hospitals providing specific services in accordance with Approved
                  Standards

Table 2b          Adequacy of Provision of Specified RH Services in Provincial Hospital and Two District Hospitals based on Approved Standards,
                  Nueva Vizcaya (year)

                                                                        Provincial Hospital          District Hospital (1)        District Hospital (2)
                                Services                            Meeting Approved Standards   Meeting Approved Standards   Meeting Approved Standards
                                                                       No              Yes            No               Yes        No              Yes

         1. All reversible modern FP methods
         2. MHC and assisted delivery
         3. Prevention and management of RTIs/STD and
         prevention of HIV/AIDS
         4. Management of consequences and complications of
         abortion
         5. Emergency obstetric care
         6. VSC
         7. Identification and referrals of breast and RT cancers
         8. Identification and referrals of infertility
         9. Information, education and counselling on RH
         including FP

         Procedure:

         1.       For provincial hospital and designated district hospitals, apply Q of Care checklist for aforementioned services.
         2.       For the provincial hospital and district hospitals, indicate which services met approved standards.
         3.       Explain observations.
         4.       Provide recommendations to improve/introduce services.

         Forms:

         1.       List of services specified in provincial hospital and 2 district hospitals
         2.       Q of C checklist



                                                                                                                                                      28
OVI 2c          All BHSs in pilot areas and all RHUs providing counselling and/or services according to approved standards

Table 2c        Number of BHSs in pilot areas and RHUs providing counselling services according to approved standards, Nueva Vizcaya
                (year)

                                                                         Areas

      1. BHSs                                        No.    %      No.     %      No.    %      No.    %      No.    %       No.    %
                                                           100.0          100.0         100.0         100.0         100.0          100.0
      a. Providing counselling alone
      b. Providing counselling/recommendations
      c. Providing services alone
      d. Providing services according to approved
      standards
      2. RHUs
      a. Providing counselling alone
      b. Providing counselling according to
      standards
      c. Providing services alone
      d. Providing services according to standards
      e. Providing with counselling and services
      f. Providing counselling and services
      according to standards


      % will be based on the total BHS in the pilot areas and all RHUs




                                                                                                                                       29
Procedure:

1.    For BHS in pilot areas and RHUs in pilot areas, obtain those:

      a)     providing counselling alone
      b)     providing services alone
      c)     providing counselling and services

2.    Apply Q of C checklist for counselling and services.

3.    Determine scores.

4.    Determine cut-off point. Assess the number of BHS and RHUs providing
      counselling and/or services that meet approved standards (equal to or above cut-off
      point).

5.    Categorize SDPs according to service and counselling provision, based on approved
      standards.

6.    Enter the number of SDPs meeting approved standards (above cut-off points).
      Compare with expected number as indicated in logframe OVIs. Provide explanation
      for findings.

7.    Propose modifications, if needed.


Forms to be used:

1.    Pilot area reports on counselling and services for BHS and all area reports for RHU
2.    Q of C checklist for services
3.    Checklist for approved standards for counselling




                                                                                            30
OVI 2d              At least 5 schools in pilot areas and 3 schools in expansion areas providing
                    counselling and services to adolescents according to agreed standards

Table 2d            Number of schools in pilot and expansion areas providing counselling and
                    services to adolescents according agreed standards, Nueva Vizcaya (year)


                                                 Pilot Areas                Expansion Areas
     Schools                               No.                 %           No.            %
                                                                   100.0                      100.0
     Providing counselling and services
     Providing counselling and services
     according to agreed standards



Procedure:

1.         Obtain number of schools in pilot and expansion areas.
2.         Obtain number of schools with counselling and services for ARH. (Get %)
3.         Apply agreed standards and obtain number and % of schools providing counselling
           and services in pilot and expansion areas meeting agreed standards (based on cut-off
           points selected).

Forms

1.         List of schools (pilot and expansion areas)
2.         List of schools with ARH counselling and services
3.         Agreed standards for counselling and services




                                                                                                31
OVI 2e     At least 50% increase in the number of male clients availing of FP services at
           all levels of SDPs

Table 2e        Percentage Increase in Male FP Clients at all Levels of SDPs, Nueva
                Vizcaya, (year: 1999-2004 or STP)


                             Start                  End/STP                % Increase between
                                           Actual        Expected *       Start and End or STP
 BHS
 No. of male FP Clients
 (Vasectomy +
 Condom)
 RHUs
 No. of male FP clients
 Hospitals
 No. of male FP clients

STP – Specific Time Point

* For the expected number of clients multiply the number at the start by 1.5


Procedure:

1.    From the client records (service statistics), obtain the number of male FP clients
      (condom and vasectomy) [new and continuing] in the first quarter of the start of the RH
      sub-programme.
2.    Multiply the number by 1.5 to obtain the expected number of clients at the end of the
      Sub-programme period.
3.    Obtain the actual number of clients based on service statistics. Compare with expected
      numbers. Determine % increase or decrease.
4.    Identify SDPs with short falls (expected exceeded actual numbers). Posit explanations
      for the observations.
5.    Identify areas where promotion of male contraceptive use needs to be enhanced.

Form

1.    Service statistics on male FP clients by SDP(1st quarter of SP inception and last quarter
      of implementation or specific time point.




                                                                                              32
OVI 2f      At least 80% of clients are satisfied with the specific services (see Table f) by
            category of SDP

Table 2f         Percentage of clients satisfied with specific RH services by sex and type of
                 SDP

                                                                                Satisfied
             Services                Hospital     Total Interviewed       No.               %
                                                M        F        A   M    F    A     M     F        A

1. FP
2. MCH and assisted delivery
3. Prevention and management of
RTIs/STDS and prevention of HIV-
AIDS
4. Prevention and management of
abortion and its complications
5. Identification and referrals of
breast and RT cancers
6. Identification and referrals of
infertility
7. Information, education and
counselling on RH including FP

M - Male
F - Female
A - Adolescents

Prepare similar tabulations for RHUs and BHSs.


Procedure:

1.       Refer to RH QOC Survey according to specific service for specific clients (male,
         female, adolescent) by SDP.
2.       Assess satisfaction level by obtaining % satisfied for each type of service by SDP:
         a.      FP
         b.      MCH and assisted delivery
         c.      Prevention and management of RTIs/STDs and prevention of HIV/AIDS
         d.      Prevention and management of abortion and its complications
         e.      Identification and referrals of breast and RT cancers
         f.      Identification and referrals of infertility
         g.      Information, education and counselling on RH including FP

3.       Compare % with the expected 80%.
4.       Determine % equal to or above the expected 80%.
5.       Posit explanations.
6.       Provide recommendations.

Source:

QOC of survey for males, females and adolescents (locate items in survey questionnaire)



                                                                                                33
OVI 2g     At least 85% increase in number of VAW clients going to participating
           agencies for services, counselling and referral

Table 2g Percentage Increase in VAW clients of specified participating agencies (year)

                                                   Number of VAW Clients
 Participating Agencies         Start of Project       End of Project*             %
                                   (1st Qtr)              (Last Qtr)            Increase/
                                                                                Decrease
 RHU
 Hospital
 Police
 Judiciary
 Local Government
 Welfare Services

* or designated time point


Procedure:

1.     For each participating agency, obtain from service statistics, number of VAW clients
       in the first quarter of the project implementation.
2.     Obtain number of VAW clients in the last quarter of project implementation.
3.     Obtain % increase or decrease:

       No. of clients          - No. of clients
       at the end of project   at start of project
       implementation          implementation
       _________________________________________ X 100

       No. of clients at start of project implementation


4.     Assess whether the obtain value is equal to or close to the indicated 85%.
5.     Specify agencies with shortfalls.
6.     Propose recommendations to arrive at expected increase.


Source of Information

Service statistics of participating agencies.




                                                                                            34
OVI 3a         80% of trained midwives, nurses and doctors at all SDP levels able to
               provide counselling and basic RH services (FP, MCH, STD/HIV/AIDS)
               according to approved standards

Table 3a       Percentage of trained service providers by SDP type able to provide
               counselling and basic RH services according to approved standards by
               province, year

                                         Province                                Providing Counselling and
                          Number             Providing Counselling and Basic    Basic RH Services according
Type of SDP                                            RH Services                to Approved Standards
and Category     Total         Trained     Number          % of trained staff   Number      Row %
of Provider                                                                                 (% of trained
                                                                                            staff providing
                                                                                            counselling
                                                                                            and services
                                                                                            according to
                                                                                            approved
                                                                                            standards
Hospital
  MD
  Nurse
Midwife
RHU
  MD
  Nurse
Midwife
BHS
  MD
  Nurse
Midwife


Obtain separately by province and for all provinces taken together.


Procedure:

1.         For each province, obtain number and type of service providers by type of SDP.
2.         Determine number providing counselling and core RH services.
3.         Apply QOC checklist.
4.         Determine number and percentage providing counselling and core RH services
           according to approved standards (those equal to or greater than cut-off cut off points).
5.         Compare with expected 80%. Identify type of provider, SDP and provinces below
           standard the cut-off score. Explain.
6.         Provide recommendations.

Sources of information:

1.         Type of provider by SDP and services provided.
2.         QOC observation checklist.
3.         Number of providers and those trained.




                                                                                                        35
  Output 3b 80% of trained service providers (midwives, nurses, doctors, MPOs,
  MSWDOs and other non-health professionals) in pilot areas able to provide counseling
  on VAW and ARH according to approved standards.

  Table 36. Percentage of trained service providers in pilot areas providing counselling
            on VAW and ARH according to approved standards


     Type of Service                                      PILOT AREAS
        Provider        Number                  Trained          Providing Services according to
                                                                      Approved Standards
                                          VAW           ARH         VAW               ARH
                                    No.         %    No.    %     No.     %      No.       %*




     Total

*% of trained providers

Procedure:

1.      Obtain number and type of service providers for a) VAW b) ARH by SDP.
2.      Obtain number trained for VAW and ARH.
3.      Use VAW and ARH counselling observation checklist.
4.      a. Obtain performance scores for each type of provider.
        b. Compare with cut off scores.
5.      Determine per cent of total trained service providers giving counselling according to
        approved standards. Compare with 80% target set.
6.      Find out reason(s) for short fall or achievement.
7.      Posit recommendations.

Sources of Information:

1.    List of providers by functional category providing VAW and ARH counselling by SDP.
2.    Counselling observation checklist.




                                                                                                36
OVI 4a at least 70% of men, 80% of women and % of adolescents able to identify
specific RH issues (a) at least 3 modern methods of FP; (b) at least 3 signs and
symptoms of pregnancy; (c) at least 3 modes of transmission of STD/HIV and AIDS, (d)
sources outlets for counseling and RH management and (e) Gender issues in RH.

Table 4a       Percentage of men, women and adolescents able to identify specific RH
               issues by Province (year)

                                       Province
                                         Number             Number able to identify
                                       interviewed            specific concerns
 RH Issues                                                  M             F             A
                                       M   F      A   No.       %   No.       %   No.       %
 1. At least 3 modern methods of FP

 2. At least 3 signs and symptoms
    of pregnancy

 3. At least 3 modes of transmission
    of STD/HIV/AIDS

 4. Service outlets providing
    counselling and management of
    RH

 5. Gender issues in RH such as
    male and female shared sexual
    responsibility


  Procedure:

 1. Determine number of interviewees (male, female, adolescents) by province.
 2. Determine number able to identify specific concerns by type of interview.
 3. Obtain % able to identify specified concerns. Compare with the expected 70% for men,
    80% for women and 70% for adolescents.
 4. Identify knowledge areas to be strengthened type of target and specific provinces.




                                                                                                37
OVI 4b At least 50% of men, 70% of women and 60% of adolescents able to discuss
the following:

(1)    At least 3 modern methods of FP, its advantages and disadvantages;
(2)    At least 3 signs and symptoms of pregnancy;
(3)    At least 3 modes of STDHIVAIDS transmission;
(4)    RH services provided by health facilities: and
(5)    Gender issues.

Table 4b Percentage of men, women and adolescent able to discuss specific RH issues
         by province (year)

                                        Province and Total
                                          Number
                                        interviewed    Number with Correct Answers
  OVI 4b                                                    M             F             A
                                        M    F   A    No.       %   No.       %   No.       %
  At least 50% of men, 70% of
  women and 60% of adolescents
  able to discuss the following:

  1. At least 3 modern methods of
     FP, advantages and
     disadvantages

  2. At least 3 signs and symptoms
     of pregnancy

  3. At least 3 modes of transmission
     of STD/HIV/AIDS

  4. RH services provided by health
     facilities

  5. Gender issues in RH such as
     male and female shared sexual
     responsibility


  Procedure:

 1. Determine number of interviewees for each item.
 2. Determine number and % able to discuss the specific issue by sex of respondent.
 3. Identify areas that need to be discussed in future IEC campaign.

 Source of Information:

 QOC Questionnaire (item duly located)




                                                                                                38
        OVI5a At least 90% of provincial and 70% of municipal managers able to plan
        programmes and implement projects according to approved standards

        Table 5a Percentage of Provincial and Municipal Managers able to plan and
        implement project according to approved standards (year)


                                                                                                     Province




                                                               Nueva Vizcaya




                                                                                                                                         Sultan Kudarat




                                                                                                                                                                                      Maguindanao
                                                                                                                                                                 Cotabato
                         Cagayan




                                                                                                                        Antique
                                            Quirino




                                                                                        Aklan




                                                                                                         Capiz




                                                                                                                                                                                                           Total
                No   %             No   %             No   %                   No   %           No      %        No    %          No    %                 No    %           No   %                  No    %

Number of
provincial
managers
                     100.0              100.0              100.0                    100.0             100.0           100.0            100.0                   100.0             100.0                   100.0

able to plan
and implement
programs
according to
approved
standards



Number of
municipal
managers

                     100.0              100.0              100.0                    100.0             100.0           100.0            100.0                   100.0             100.0                   100.0

able to plan
and implement
project
according to
approved
standards


%




        Procedure:

        1.       Obtain programme and implementation plans.
        2.       Subject to a adequacy check list to assess capacity for programme planning and
                 implementation.
        3.       Obtain score for each provincial and municipal manager; determine cut-off score.
        4.       Obtain% of provincial and municipal managers with scores equal to or above the cut-
                 off score (standard).
        5.       Compare with target 90% for provincial managers and 70% for municipal managers.
        6.       Identify areas that need to be strengthened in training and geographical areas to focus
                 on future training.


                                                                                                                                                                                 39
OVI 5b Policies, programme plans, systems and procedures addressing specific RH
needs of men, women, adolescents

Table 5b Extent of Incorporation of Specific RH Needs of Men, women and
Adolescents in Policies, Plans, Systems and Procedures, Province, Year

  Province                                        Reflected in
 Specific RH
   Needs
                          Policies          Programme     Systems             Procedures
                            ( )                Plans        ( )                  ( )
                                                ( )
                    Yes              No   Yes        No Yes     No          Yes         No
Men




Women




Adolescents





Yes - 1
No – 0

Procedure:

1.        Determine RH needs from stakeholders’ analysis and review of literature/document
          (list and prioritize).
2.        Review relevant policies, programme plan, systems and procedures to assess if RH
          needs are reflected or not. Score 0 (if not) or 1 (if reflected).
3.        Obtain number of particular issues reflected in policies, programme, systems or plans.
4.        Identify areas for improvement.

Information Needs:

1.        Policies, Programme Plans, Systems, Procedures (determine if relevant).
2.        Specific RH priorities listing.




                                                                                              40
     OVI 6a

          At least 80% of target adolescents and youth able to identify 3 possible consequences of
           unprotected sex
          At least 70% of target adolescents and youth able to identify at least 3 modern methods of
           FP
          At least 80% of target adolescents and youth are knowledgeable of the 3 modes of
           transmission of HIV/AIDS
          At least 80% of target adolescents and youth are knowledgeable of at least 3 methods of
           prevention of HIV/AIDS
          At least 80% of target adolescents and youth are able to identify at least 2 common forms
           of TRI/STDs


     Table 6a Percentage of adolescents and youth with knowledge of specific RH issues by
     province, Year

                                                                                                  Province
                                                                   Nueva Vizcaya




                                                                                                                                             Sultan Kudarat




                                                                                                                                                                                          Maguindanao
                                                                                                                                                                     Cotabato
                               Cagayan




                                                                                                                            Antique
                                                Quirino




                                                                                          Aklan




                                                                                                             Capiz




                                                                                                                                                                                                               Total
                      No   %             No    %          No   %                   No    %        No    %            No    %          No    %                 No    %           No    %                 No    %
No. of
Adolescents
Interviewed*
                           100.0              100.0            100.0                    100.0          100.0              100.0            100.0                   100.0             100.0                   100.0

a. Able to identify
3 possible
consequences of
unprotected sex



b. Able to identify
at least 3 modern
FP method


c. Knowledgeable
of at least 3
methods of
HIV/AIDS
prevention


d. Able to identify
at least 2 common
form of STI/STDs



     *Use Column %




                                                                                                                                                                                     41
Procedure:

1.     From the adolescent Q and C survey, obtain number interviewed.
2.     Obtain the number and % of these:
       a) able to identify 3 possible consequences of unprotected sex
       b) able to identify at least 3 modern FP methods
       c) knowledgeable of at least 3 modern FP methods of HIV/aids prevention
       d) able to identify ( as indicated in Output OVI) at least 2 common forms of
          STIs/STDs
3.     Compare with targets and identify provinces below or above the target.
4.     Explain and posit recommendations.

OVI 6b

At least 85% of counseled cases with the following concerns are referred to partner referral
agencies:
    - RTI/STDs management & prevention
    - Unplanned pregnancies
    - Maternal and child health
    - Management of untoward consequences of abortion
    - Management of VAW including physical and sexual abuse

Table 6b Percentage of counseled counselled cases referred partner agencies by
purpose, (year)

                                                Referring Agency
Purpose of Referral               Number Counseled     1    2    3          4     5
                                        No.
RTI/STD management and
prevention
Unplanned pregnancy
MCH
Management of untoward
consequences of abortion
Management of VAW
including physical and
sexual abuse
TOTAL

* Specify referral agency

Procedure:

1.     From the service statistics in counseling points, obtain the number counseled.
2.     Indicate number referred according to purpose.
3.     Obtain % referred of total counseled by purpose of referral.

Source:

Service records


                                                                                               42
OVI 6C

At least 70% of referred cased actually provided the services for
    - RTI/STDs management & prevention
    - Unplanned pregnancies
    - Maternal and child health
    - Management of untoward consequences of abortion
    - Management of VAW including physical and sexual abuse

Table 6c Percentage of referred cases provided with services by specific referral SDP,
(Year)

                                                        Referral SDPs
                                   A                B                   C              D
Number of referred cases     No.       %      No.         %      No.        %    No.       %
Number provided with
services:
a. RTI/STD management
b. Unplanned pregnancy
c. MCH
d. Management of
untoward consequences of
abortion
e. Management of VAW
including physical and
sexual abuse

Procedure:

1.     Obtain information from specific counseling points the number referred, place of
       referral and purpose (service statistics).
2.     Obtain from referral SDPs the number of referrals received by type of services to be
       provided.
3.     Obtain % for each service type and compare with the targeted 70%.
4.     Explain and provide recommendations.




                                                                                              43
OVI 6d At least 50% increase in the number of adolescents/youth availing of ARH
services from partner referral agencies

Table 6d Percentage increase in no. of adolescents availing of ARH services from
referral agencies

     Partner                  No. of           No. of                    %               Compare with
     Referral              adolescents       adolescents         Increase/Decreases      50% (below or
     Agencies              availing of       availing of                                    above)
                           services at     services end of
                               start           project
                          (1st quarter)       or STP*




* STP - Specific time point



                           Type of ARH services availed by referral agency

Type of                  Referral Agency              Referral Agency              Referral Agency
Services
                 Start    End/STP     I/D     Start    End/STP      I/D    Start    End/STP     I/D
                 No.        No.     No. %      No.       No.      No. %    No.      No.       No. %
MCH
Unplanned
Pregnancy
Management
of untoward
consequences
of abortion
RTI/STD
mgt

I/D = Increase/Decrease

Procedure:

1.         From service statistics of referral facilities, obtain number of adolescents
           (male/female) availing of services at start and end or specific time point.
2.         Compute % increase of decrease. If less than 50% increase, explain shortfall.
3.         Provide recommendations.




                                                                                                      44
OVIs 7

a.      At least 50% increase in number of clients going to participating agencies for
        counseling and referral
b.      At least 50% increase in number of referrals made by participating agencies
c.      At least 50% increase in number of referrals received by participating agencies


Table 7 Percentage Increase in client intake, referrals made and referrals received by
participating agency (Year)

                          Client Intake   % of        No. of      % of       No. of      % of
                                          Change    Referrals    Change     referrals    Change
                                                      Made                  received
                           Start   End             Start End              Start    End
                                    or                     or
                                   STP                    STP
Participating Agencies     No.     No.             No.     No.
1.
2.
3.
4.
5.

STP = Specific Time Point


Procedure:

From the service statistics provided by participating agencies, obtain client intake, referrals
made and referrals received at start and end or specific time points of project implementation.

Source:

Service statistics of participating agencies




                                                                                              45
     B. POPULATION AND
DEVELOPMENT STRATEGIES (PDS)




                               46
                          PDS SUBPROGRAMME FRAMEWORK



          Output 1                                                     GOAL
Increased access to updated       PURPOSE                  To have contributed to
gender-sensitive research         Have contributed to      improvements in the quality
and data on population and        improved utilization     of life of all Filipinos
RH issues through the             of population and        through:
production and                    RH generated gender      (a) better reproductive
dissemination of the State of     sensitive information        health
the Philippines Population        and data for keeping     (b) the attainment of
Report (SPPR) and National        strategic population         population outcomes that
Population Database               and RH issues on the         are in harmony with
                                  national agenda, and         available resources and
                                  facilitating decision-       environment conditions;
          Output 2                                             and
                                  making at both
Enhanced institutional                                     (c) the reduction of poverty
                                  national and local
capacity in generating                                         and inequalities in
information and data on           levels
                                                                human development
population and RH                                               opportunities




                                                                               47
              PDS SUBPROGRAMME OUTPUT OVI RETRIEVAL PLAN



                   OVI1                        Contextual Analysis of SPPR

National plan citing priority                      SPPR reflects the basic population
issues/concerns from SPPR and /or NPDIS             and RH issues drawn from data
                                                    base
Local plans in each of the nine (9) pilot
provinces citing priority issues and               SPPR presentation involves data
concerns from SPPR and/or NPDIS                     analysis and inferences for policy
                                                    and programme inputs
At least one (1) locally initiated policy
issuance citing SPPR and/or NPDIS
priority issues and concerns in each of the        Dissemination modality ensures
nine (9) pilot provinces                            reaching target groups.

At least one (1) policy maker in each of the
fifteen (15) regions issuing policy
statements (verbal or written) citing SPPR
priority issues and concerns

At least ten (10) articles of national
newspapers citing each SPPR priority
issues and concerns.

At least two (2) articles of local newspaper
in each of the fifteen (15) regions citing
SPPR priority issues and concerns




                                                                                         48
          BASIC TABULATION REQUIREMENTS FOR RETRIEVAL OF OVI


Table 1 Extent of Incorporation of Priority Population and RH Issues into National and
Local Planning Policies



                                                       Incorporation Into
  Priority Population and
            RH                National      Local    Policy       Policy
Issues Generated from          Plans        Plans   Issuance    Statements              No. 2
SPPR                            (No.)       (No.)     (No.)        (No.)       National        Local
                             No.    Yes   No. Yes   No    Yes   No      Yes    No    Yes     No    Yes
1. Unmet need in FP
2. Access to FP services
3. Violence against women
4. Male’s involvement
5. Teenage pregnancy
6. Prevention and
management of abortion
complications
7. Advocacy strategies for
RH
8. Inequality of women in
RH
9. POPDEV integration in
planning
10. Mobilization of
financial resources for FP


Procedure:

1.       Draw priority issues and concerns in population and RH.
2.       Compile: a) National Plan, b) Local Plan, c) Policy Issuance, d) Policy Statements,
         e) Articles (National and Local).
3.       Assess extent to which the RH priorities are reflected in the above plans based on the
         priority population and RH issues generated from SPPR.



                    OUTPUT 2                                                OVI 2

Enhanced institutional capacity for                  SPPR reflects the basic population and
generating information and data on                    RH issues drawn from database.
population and RH issues.
                                                     SPPR presentation involves data analysis
                                                      and inferences for policy and programme
                                                      inputs.

                                                     Dissemination modality ensures reaching
                                                      target groups.




                                                                                                    49
Table 2   Assessment of Enhanced Capacity of Institution to Generate SPPR


             Basis                        Inadequate                     Adequate

1. Issues efficiently derived
from the date presented
2. Presentation of
information clear enough to
infer on issues (tables, text
and analysis)
3. Inferential analysis.
Implications of findings
clearly indicated; explanatory
factors for major issues
provided
4. Recommendations
succinct and directly linked to
findings
5. Dissemination modality
reaches wider audience


Procedure:

1.     Prepare adequacy checklist using the criteria set in the table.
2.     Assess if adequate or inadequate.
3.     Posit reasons and recommendations.




                                                                                    50
C. ADVOCACY




              51
                         PHPILIPPINE ADVOCACY SUB-PROGRAMME




Output 1                                                         GOAL

MORE SUPPORTIVE                    PURPOSE                       To have contributed to the
Environment for a sustainable                                    improvement in the quality of
population and RH sensitive        To have contributed to the    life of all Filipinos through:
policy decision-making at the      increased political,          a) better reproductive;
NATIONAL LEVEL                     institutional and community   b) the attainment of
                                   support at the national and        population outcomes that
                                   local levels for the               are in harmony with
Output 2                           development and                    available resources and
                                   implementation of a gender-        environmental conditions;
Strengthened capacity of           sensitive, comprehensive           and
NGOs, women and youth              population and RH policy      c) the reduction of poverty
organizations, mass media          and                                and inequalities in human
producers and practitioners for                                       development opportunities.
advocacy on population, RH
and gender issues




                                                                                       52
Advocacy Checklist

Output 1 – Supportive environment for a sustainable population and RH sensitive policy-making at the national level.
Table 1: Percentage of Legislators Supportive of RH by Modality and Issues Addressed
           OVI                                Data Requirement                     2000         2001         2002      2003   2004   Total
                               Total number of legislators
OVI 1
                               Number of legislators making public statements in
At least ___ legislators/      support of population and RH
parliamentarians making        Modalities/medium of public statements
public statements in support        speech
of RH                               news/feature article
                                    opinion/editorial article
                                    publication message
                                    electronic broadcast
                                    policy forum
                                    broadcast interview
                               Issues addressed
                               FP/RH
                                    Lack of access to high quality RH/FP
                                        information & services
                                    Contraceptive financing
                                    Low contraceptive financing
                                    Low contraceptive prevalence rate
                                    Organizational support for policy
                                        development re Reproductive Rights
                                    Prevention & management or abortion
                                    Prevention & treatment of RTIs, including
                                        HIV/AIDS
                                    Sustained funding, staffing and
                                        administration of FP service delivery by
                                        LGU
                               Mortality
                                    high infant mortality
                                    high rate of maternal deaths
                                    geographical differentials in mortality
                                        patterns




                                                                                                                                        53
ARH
       High incidence of teenage pregnancy
       Responsible sexuality and reproductive
        rights concerns among Muslim families
       Access to information and provision of
        services
       Involvement of more organizations &
        stakeholders in adolescent reproductive
        health
       Involvement & education of
        parents/guardians on sexuality & other
        reproductive health concerns within the
        context of family life
       Integration of ARH concerns in the school
        curriculum

Gender
    Violence against women and young girls
       (such as domestic violence, wife beating,
       forced sexual encounters resulting to
       unwanted pregnancies)
    Unequal opportunity for young girls
    Unequal opportunity for women in work
       place
    Male involvement in family planning,
       domestic violence, and STD/AIDS
       prevention

Population & Development
    POPDEV Integration in planning
    Data & information on population &
         development
    Urbanization & migration
    Population ageing




                                                    54
Venue of public address
    public hearing
    press/media conferences
    conference/for a
    seminar
    radio/television programme
    special event (launching of SWPR/SPPR)
    ambush interview
    others


Audience reach
    academic community
    policymakers
    local leaders
    adolescent organizations
    women’s groups
    NGO community
    religious sector
    multi-sectoral body/group
    general public




                                              55
OVI 2                    Number of Public Debates for Relevant
                         Population, RH and VAW Issues for type and
                         issues addressed
At least ___ public
                         Number of public policy debates related to
policy debates dealing   population, RH & VAW
with relevant
                         Type
population, RH &
                              Fora
VAW issues annually           Symposia
                              Public deliberation
                              Senate/Congress hearing
                              Special events (launching of
                                 SWPR/SPPR)
                         Issues addressed
                         FP/RH
                              Lack of access to high quality RH/FP
                                 information &services
                              Contraceptive financing
                              Organization support for policy
                                 development re Reproductive Right
                              Prevention & management of abortion
                              Prevention & treatment of RTIs,
                                 including HIV/AIDS
                              Sustained funding, staffing and
                                 administration of FP service delivery
                                 by LGU




                                                                         56
ARH
      High incidence of teenage pregnancy
      Responsible sexuality and
       reproductive rights concerns among
       Muslim families
      Access to information and provision
       of services
      Involvement of more organizations &
       stakeholders in adolescent
       reproductive health
      Involvement & education of
       parents/guardians on sexuality &
       other reproductive health concerns
       within the context of family life
      Integration of ARH concerns in the
       school curriculum

Gender
    Violence against women and young
       girls (such as domestic violence, wife
       beating, forced sexual encounters
       resulting to unwanted pregnancies)
    Unequal opportunity for young girls
    Unequal opportunity for women in
       work place
    Male involvement in family planning,
       domestic violence, and STD/AIDS
       prevention

Population & Development
    POPDEV Integration in planning
    Data & information on population &
        development




                                                57
Venue of public address
    Public hearing
    Press/media conferences
    Conference/for a
    Seminar
    Radio/television programme
    Special event (launching of
       SWPR/SPPR_
    Ambush interview
Audience reach
    academic community
    policymakers
    local leaders
    adolescent organizations
    women’s groups
    NGO community
    Religious sector
    Multi-sectoral body/group
    General public




                                   58
Output 2: Strengthened capacity of NGOs, women& youth organizations, mass media producers & practitioners for advocacy
Table 2: Assessment of strengthened capacity of NGOs, women and media Producer for advocacy

OVI 1               Number of national/international conference        Local   National   L   N   L   N   L   N   L   N   L    N
Convergence/meeting convened by special thematic area:
of multi-sectoral       RH/FP
groups to discuss       ARH
                        Population & Development
relevant population
                        Gender (VAW, male participation)
and RH issues

                          Number of network alliances created
                              Multi-sectoral
                              NGO
                              Women
                              Youth
                              Academe
                              Policy makers
                              Organization



                          Number of users of the guide developed for
                          RH Advocacy


OVI 2                     Purpose of utilization of the guide
One guideline on              training/orientation
advocacy for population       advocacy campaign (planning &
& RH developed &                 implementation)
utilized                      production of advocacy/IEC
                                 materials
                              reference in the university




                                                                                                                              59
Table 3: Percentage of trained NGOs, Women, Youth and Media Advocate conducting Advocacy on Important Population, RH and
Gender Issues according to approved Standards

OVI 3                 Number of advocates trained
At least 60% of           GO
trained NGO,              NGO
women, youth and          Women
media advocates           Youth
                          Media
conducting
advocacy activities
on important          Number of advocates conducting advocacy
population, RH        activities according to approved standards
and gender issues          Go
at the national            NGO
level according to         Women
approved                   Youth
standards                  Media

                      Issues advocated
                      FP/RH
                           Lack of access to high quality RH/FP
                              information & services
                           Contraceptive financing
                           Organizational support for policy
                              development re Reproductive Rights
                           Prevention & management of
                              abortion
                           Prevention & treatment of RTIs,
                              including HIV/AIDS
                           Sustained funding, staffing and
                              administration of FP service delivery
                              by LGU




                                                                                                                    60
ARH
        High incidence of teenage pregnancy
        Responsible sexuality and
         reproductive rights concerns among
         Muslim families
        Access to information and provision
         of services
        Involvement of more organizations &
         stakeholders in adolescent
         reproductive health
        Involvement & education of
         parents/guardians on sexuality &
         other reproductive health concerns
         within the context of family life
        Integration of ARH concerns in the
         school curriculum

Gender
        Violence against women and
         young girls (such as domestic
         violence, wife beating, forced
         sexual encounters resulting to
         unwanted pregnancies)
        Unequal opportunity for young girls
        Unequal opportunity for women in
         work place
        Male involvement in family planning,
         domestic violence, and STD/AIDS
         prevention

Population & Development
    POPDEV Integration in planning
    Data & information on population &
        development




                                                61
                      BASIC INFORMATION NEEDS TO GENERATE
                 REPRODUCTIVE HEALTH-SUBPROGRAMME (RH-SP) OVIs

OVI 1a and 1b                                                        DOH provincial listing; QOC
                                                                     facilities and observation checklist
No. of BHSs and RHUs                                                 by type of SDP
No. of BHs and RHUs with 4 core services
No. of referral hospitals
No. of referrals hospitals with package of 7 services
No. of SDPs observed meeting approved standards

OVI 1c                                                               DOH listing of BHSs in pilot areas
                                                                     and RHUs
No. of BHSs in pilot areas                                           Adolescent counselling approved
No. of RHUs                                                          standards for RHU and BHS
No. of BHSs in pilot areas providing adolescent Counselling
No. of RHUs providing counselling
No. of SDPs observed meeting approved standards

OVI 1d                                                               ARH project listing from
                                                                     Schools and NGOs
No. of NGOs per province in pilot areas                              Adolescent counselling and referral
No. of schools per province in pilot areas                           approved standards checklist
No. of NGOs and schools providing counselling and referrals
No. of SDPs observed meeting approved standards

OVI 1e                                                               Service Statistics


No. of male clients availing of FP and RH services
by BHS, RHU, hospital by province
           -   1st quarter of project implementation
           -   last quarter of project implementation or specified
               time points

OVI 1f                                                               Clients interviews (Q of C)

No. interviewed availing of each of the services:                    (Male, Female, Adolescents)

 FP, MCH, RTI/STD/HIV, ARH (M, F, A)

No. satisfied with each of the above services




                                                                                                        62
OVI 2a                                                           PHO listing of BHSs and RHUs
                                                                 QOC standards
No. of BHS                                                       (observation checklist for BHS,
No. of RHUs                                                      RHU, hospital)
No. of BHSs and RHUs providing package of 7 services
No. of district hospitals
No. of providing package of 9 services
Provincial hospital providing package of services
No. observed meeting approved standards

OVI 2b                                                           PHO listing of BHS in pilot areas
                                                                 and RHUs
No. of BHSs in pilot areas                                       QOC standards
No. of RHUs
No. of SDPs providing counselling and/or services
No. observed providing C and S according to approved standards

OVI 2c                                                           - Project listing
                                                                 - Counselling and services
No. of schools in pilot areas                                    standards checklist
No. of schools in expansion areas
No. of the above providing counselling and services
No. of the above observed meeting approved standards

OVI 2d                                                           Service statistics

No. of male FP clients at start and end of the project by SDP
OVI 2e                                                           Clients’ QOC interviews

No. of clients availing of specific services
No. satisfied with:

   1) FP
   2) MCH and assisted delivery
   3) Prevention and management of RTIs/STDs and prevention
      of HIV/AIDS
   4) Prevention and management of abortion and its
      complications
   5) Identification and referrals of breast and RT cancers
   6) Identification and referrals of infertility
   7) Information, education and counselling on RH including
      FP




                                                                                           63
OVI 3a                                                             DOH listing of service
                                                                   providers
No. of midwives, nurses and doctors at all SDP levels              Technical competence
No. observed                                                       checklist (part of QOC
No. meeting approved standards                                     checklist)


OVI 3b                                                             DOH listing of service
No. of service providers                                           providers
No. of trained service providers                                   Technical competence
No. providing counselling on VAW and ARH                           checklist
No. observed
No. meeting approved standards

OVI 4a                                                             Clients’ QOC Survey

No. interviewed (Males, Females, Adolescents)
No. availing of following services with knowledge of:
   1) at least 3 modern methods of FP
   2) at least 3 signs and symptoms of pregnancy
   3) at least 3 modes of transmission of STD/HIV/AIDS
   4) service outlets providing counselling and management of RH
   5) gender issues in RH such as male and female shared sexual
        responsibility


OVI 4b                                                             Clients’ QOC survey

No. interviewed (Males, Females, Adolescents)
No. able to discuss:
   1) At least 3 modern methods of FP
   2) At least 3 signs and symptoms of pregnancy
   3) At least 3 modes of transmission of STD/HIV/AIDS
   4) Service outlets providing counselling and management of RH
   5) Gender issues in RH such as male and female shared sexual
        responsibility


OVI 5a                                                             DOH/NGO listing of
                                                                   managers
No. of provincial and municipal managers                           Planning and implementation
No. able to plan and implement projects according to approved      adequacy checklist
standards




                                                                                         64
OVI 6a                                                                  Clients’ Q of C survey

No. of adolescents and youth interviewed
No. able to:
   1) Identify 3 possible consequences of unprotected sex
   2) Identify at least 3 modern methods of FP
   3) Identify the 3 modes of transmission of HIV/AIDS
   4) Identify at least 3 methods of prevention of HIV/AIDS
   5) Identify at least 2 common forms of RHI/STDs


OVI 6b                                                                  Service statistics of
                                                                        participating agencies
No. of counselled cases by participating agency
No. referred to partner agencies for:
   1) RHI/STDs management and prevention
   2) Unplanned pregnancies
   3) Maternal and child health
   4) Management of untoward consequences of abortion
   5) Management of VAW including physical and sexual abuse


OVI 6c                                                                  Service statistics of ARH
                                                                        participating agencies
No. of referred cases by receiving agencies and specific services
referred for
No. of referred cases provided with services for:
    1) RTI/STDs management and prevention
    2) Unplanned pregnancies
    3) Maternal and child health
    4) Management of untoward consequences of abortion
    5) Management of VAW including physical and sexual abuse
By participating agency

OVI 6d                                                                  Service statistics of
                                                                        participating agencies
No. of clients availing ARH services by partner agencies at the start
and end of project implementation
No. of clients by participating agencies at start and                   Service statistics of VAW
                                                                        participating agencies
end of the project availing of counselling and
referral services

No. of referrals made by participating agency (start and end)

No. of referrals received by participating agencies




                                                                                             65
                       INSTRUMENTS/FORMS/INFORMATION




In Project Areas


1.    DOH listing of RHUs, BHSs, hospitals

2.    DOH listing of providers by SDP

3.    Service statistics of clinics:
         - client intake
         - male client intake
         - referrals
         - services

4.    ARH project listing of schools and NGOs (including those involved in ARH)

5.    Clients QOC interviews:
          - male
          - female
          - adolescents

6.    QOC standards (observation checklists)

7.    Adolescents QOC approved standards (observation checklists) (counselling and
      services)

8.    Planning and implementation checklist

9.    VAW counselling checklist




                                                                                     66
ASSESSMENT OF EXTENT OF ACHIEVEMENT OF TARGET OUTPUT OVIs



A.   Output OVIs


     1.   Obtain computed OVI values for each output.
     2.   Compare with the target OVIs specified in the logframe.
     3.   Determine the extent of attainment of output OVIs. At a specific time point,
          how far is the obtained value from the target value?
     4.   Determine the factors accounting for the shortfalls or achievement:

          a) Are the targets set realistic?
          b) Have all the specified activities been undertaken based on the activity
             OVIs? Which were not? Why were they not undertaken?
          c) Did the specified activities lead to the attainment of output OVIs?
          d) Have there been changes in the external environment that accounted for
             the shortfall in attainment of output OVIs?
          e) What programmatic factors accounted for the noted observations? (e.g.
             training, logistics, equipment, supervision)

     5.   Specify/propose modifications to be made (target, activities, adjustment to
          external environment).


B.   Purpose OVIs

     6.   If the purpose OVIs have been generated at the provincial and national level,
          determine extent to which the purpose OVIs reflected in the logframe matrix
          in the provinces are close to the national values.
     7.   How far are your purpose OVIs from the national levels? From the provincial
          levels?
     8.   Does the attainment of the output OVIs lead/contribute to the attainment of
          purpose OVIs? Explain.




                                                                                         67

								
To top