CALL FOR EXPRESSIONS OF INTEREST Activity – VE-0084: Ex-Post Evaluation an Electricity Program in Venezuela Office of Evaluation and Oversight, Inter-American Development Bank This is a call for individual consultants interested in conducting an ex-post evaluation of one Electricity Program financed by the Inter-American Development Bank (IDB) in Venezuela. This document details the content and procedures for submitting an expression of interest. Please note that the IDB can only contract consultants from its member countries. I. 1.1 BACKGROUND Within the monitoring and evaluation (M&E) framework of the Inter-American Development Bank (IDB), the Office of Evaluation and Oversight (OVE) undertakes the independent evaluation of Bank interventions through both Ex-Post Sustainability Assessments (EPSAs) and Ex-Post Impact Evaluation Reports (IERs), in accordance to the Bank’s policy on ex-post evaluation of operations.1 OVE selected the theme of Electricity Programs, or projects with significant Electricity components. The general purpose of the operation to be evaluated (VE0084: Caruachi Central Hydroelectric2) was to help meet the growing demand for electric power within the Bolivarian Republic of Venezuela. At the same time, the operation aimed to support the electrical sector reform program being implemented by the government, particularly with respect to the establishment of a suitable regulatory and institutional framework and of a pricing policy for electricity and fuels for electricity production, to encourage more efficient use of energy resources. Additionally, the project included the implementation of measures to reduce or compensate the negative effects on the environment. The project was executed by CVG Electrificación del Caroní, C.A. (EDELCA), and by Fundación para el Desarrollo del Servicio Eléctrico (FUNDELEC). Other IDB loans in the sector include an operation approved in 2004 (VE-L1005: Institutional Development of CADAFE3), which seeks to strengthen the Electric Power Administration and Development Company’s (CADAFE); and two other operations approved in 2005, which include a loan to the Ministry of Energy and Petroleum designed to support the strategic development process of the electric sector in Venezuela (VE-L1016: TC Loan for Development of the Electric Sector4); and a loan EDELCA, to support the construction of the Tocoma hydroelectric power plant on the Lower Caroní River (VE-L1003: Tocoma Hydroelectric Power Plant5).
1.2
1.3
II. GENERAL OBJECTIVE
1 2
(GN-2254-6). http://www.iadb.org/projects/Project.cfm?project=VE0084 3 http://www.iadb.org/projects/Project.cfm?project=VE-L1005 4 http://www.iadb.org/projects/Project.cfm?project=VE-L1016 5 http://www.iadb.org/projects/Project.cfm?project=VE-L1003
2.1
This evaluation seeks to assess the impact of the Caruachi Hydroelectric Project on the economic growth and social returns, including its effects on electricity prices and access, as well as its environmental impact. The achievement of this objective will allow the IDB to rely on more robust evidence about the effectiveness of instruments. OVE will provide the consultant with access to a recent series of ex-post evaluations on this and other topics and the consultant is expected to adapt the methodology to the assessment of this case.
2.2
III. DESCRIPTION OF SERVICES 3.1 The focus of the consultancy is the ex-post evaluation of the IDB financed Caruachi Hydroelectric Program (VE0084). The other IDB operations in the sector will also have to be taken into consideration in the contextual analysis. The ex-post evaluation will include both a qualitative analysis of the project design and implementation, and a quantitative assessment of impacts on beneficiaries. The evaluation should be related to the relevant explicit objectives stated in the loan documents of the programs. In addition, OVE expects the evaluators to investigate heterogeneity of impacts across categories of beneficiaries, discuss long-run/sustainability of impacts and identify lessons learned.
3.2
IV. SUPERVISION AND OUTPUTS 4.1 The consultant(s) will report to the OVE Project Team Leader and establish a close working relationship with the OVE Project Team in Washington and in the IDB country office in Caracas, as well as with representatives from the government, in particular the FUNDELEC officials responsible for managing the programs. Working in conjunction with OVE, the consultant(s) will take leadership of the production of the following outputs: a. A brief work plan of the evaluation that includes: i) a detailed description of the methodology for the ex-post evaluation; ii) a detailed description of data gathering, compilation; and iii) the list of variables to be included in the database of the evaluations. A compilation of databases from written administrative records as needed; including data entry and data collection processes. A preliminary evaluation report, which will cover the following topics: historical and institutional background, economic background, data description and preliminary results. An evaluation report, which will include the final results of the analysis, the conclusions and lessons learned.
4.2
b. c. d. 4.3
All the information provided to OVE by the executing agencies and covered by a confidentiality agreement will bind the consultant to the same strict confidentiality terms. Consultants will make
a request for specific authorization to the executing agencies. In any case, the data used in the analysis will be clearly and precisely documented and upon authorization of the executing agencies, will be available for the exclusive purpose of replication of results. The outputs of the consultancy will be property of the IDB and the IDB has right to make them publicly available. The consultant will be bound to return or securely dispose of any data provided to her, being expressly precluded from appropriating it for her own use in any other activity.
V. 5.1
CONTENT OF THE PROPOSAL Expressions of interest must be accompanied with a brief proposal (ideally 2 to 5 pages) defining the methodology for achieving the objectives of the evaluation as well as a preliminary work plan for completing the work and deliver the outputs. The proposal should at a minimum, address the core developmental measures to be evaluated. The choice of the proper methodology will be determined by the questions to be answered and the data availability. The methodological proposal should be a description of both the qualitative and qualitative methods that will be used. After the selection of the consultant(s) more detailed work plan will be agreed upon. The work plan should be designed on the basis of the following milestones:
October November
P re lim ina ry re po rt
5.2
5.3
December
Eva lua tio n re po rt
M e tho do lo gic a l re po rt
VI. SELECTION CRITERIA 6.1 6.2 6.3 Selection of the consultant(s) will be done by the Ex-Post Evaluation Group at OVE, and will be mainly based on the proposals and qualifications provided by potential consultants. Proposals should include details on data use, indicators of impact, methodology, strategy for institutional analysis, work plan, costs, and should include CV(s) of the consultant(s). The criteria that will be used for selection of the proposals are the following: a. b. c. d. Coverage: The proposal should respond to the greatest feasible number of evaluative questions (relevance, efficiency, effectiveness, and sustainability) applicable to the program. Method: the methods proposed should be adequate to identify the impacts of the program. Timetable/Workplan: The workplan is feasible to meet the requirement of the assignment. Cost: The cost of the proposal given the availability of data, analysis, method, and other aspects of the proposal should be reasonable and feasible.
e.
Consultant(s): the following will be taken into consideration: i. ii. Education: Professionals with a post-graduate degree in economics or related field. Quantitative analysis skills: The consultant must clearly prove to have strong quantitative skills and expertise in the use of standard data management software (e.g. Access) and statistical analysis packages (e.g. STATA, E-Views, SAS). Previous experience in impact evaluations: a strong preference will be given to candidates with training and research experience in impact evaluations and to candidates that can demonstrate relevant previous experience in experimental or quasiexperimental impact evaluations. Preference will be given to professionals with experience in the Venezuelan Electricity sector. Language proficiency and previous experience in Venezuela: the consultant(s) must be able to speak and write in Spanish and preference will be given to consultants with previous experience in Venezuela.
iii.
iv. v.
VII. PAYMENTS 7.1 7.2 An amount of 22 million Bolivars has been budgeted for this activity. OVE reserves the right to modify amounts considering the quality of the proposal, or for any reason at its discretion. Payments will be linked to outputs as agreed to in the work plan, and will be subject to the approval of the outputs received by OVE. In cases when outputs are submitted after the agreed due dates, payments may be delayed accordingly.
VIII. DEADLINES 8.1 The deadline to submit proposals for the evaluation is by close of business on October 25, 2006. Complete applications include the evaluation proposal and the CV(s) of the consultant(s). The documents should be written either in English or Spanish. Proposals have to be sent via e-mail to ovesurvey@iadb.org. Please indicate “Activity – VE-0084” in your e-mail’s subject line.