RFP11-15

Evaluating the Methods Used to Measure CLASP’s Impacts

Background

CLASP improves the environmental and energy performance of the appliances and related systems we use every day, lessening their impacts on people and the world around us. CLASP develops and shares transformative policy and market solutions in collaboration with global experts and local stakeholders.

With the objective to accelerate the implementation of comparable, transparent, and effective appliance efficiency policies around the world, CLASP works through global cross-cutting programs and provides direct technical assistance to policymakers on the ground.

CLASP’s Global Best Practices program accelerates energy savings from appliance efficiency by identifying, comparing, and disseminating international best practice—and helping decision makers replicate these practices. CLASP’s Country Program teams work at the local, national, and regional level, providing technical and strategic assistance to policymakers across the world to implement the most appropriate and cost-effective appliance S&L solutions. CLASP’s Clean Energy Access Program leverages CLASP’s experience in appliance energy efficiency market transformation to develop and implement innovative programs that accelerate the social and environmental benefits of access to clean energy services throughout the developing world.

Whenever possible, CLASP aims to quantify the energy and CO2 savings from the policy measures that are put in place or improved as a result of CLASP’s programs. Over the past 15 years, CLASP has used several different analytical models and data sources to generate ex ante estimates of energy and CO2 savings that have resulted from our work. These models include the Bottom-up Energy Analysis System (BUENAS) and the Product Policy Analysis Tool (PPAT).

The metrics that come out of these models are referenced in communications with potential and existing funders, strategic partners, and the general public.  Transparency is a core CLASP value, so we are seeking to develop and put in place a robust system to evaluate the effectiveness of our programs.

Information on the project objectives, scope of work, reporting and deliverables is provided below, as well as the project timeline and application instructions.

Project Objectives

CLASP seeks a consultant to evaluate the different methodologies used to measure savings, provide an independent third party review of results from 2012-2014, and make recommendations for how CLASP can measure impacts in the future.

The consultant will evaluate the use of BUENAS, PPAT, and other methodologies used to measure the impact from policies in countries[1] where CLASP has worked. The consultant will then make recommendations for how to improve savings estimates for countries in which CLASP is currently working or may work in the future, including guidance on how to determine attribution whenever possible.

Calculating energy and CO2 savings is a single component of a broader organizational effort to improve monitoring and evaluation (M&E) practices. The consultant will also advise CLASP in the development of a broader set of metrics that can be used to evaluate program impacts beyond energy and CO2 savings. For example, CLASP has a rapidly growing Clean Energy Access program that aims to use energy efficiency as a tool to minimize the financial, social and environmental costs of expanding energy services. The metrics for success for this program are different than those for CLASP’s on-grid programs.

CLASP would also like to measure other co-benefits of energy efficiency, including industrial competitiveness, financial savings, peak load reductions, etc. In addition, there are other components of S&L programs, such as compliance, that are critical to programmatic success, but difficult to measure. When possible, CLASP would like to measure the broader impacts of its projects and programs.



[1] India, China, and the EU at a minimum.

Scope of Work

The Consultant will be responsible for the following tasks:

  1. Review all available inputs, assumptions, models, and methods that CLASP and our partners have developed and used to estimate the energy and CO2 savings from CLASP’s programs.
  2. Interview staff involved in a range of projects to better understand CLASP’s contribution to policy implementation.
  3. Review methods and draft results of energy and CO2 savings for 2012-2014 and suggest revisions if necessary.
  4. Make recommendations for how the process (data collection, definition of assumptions, calculations, and documentation) can be improved. Refine and validate these recommendations through discussion with CLASP program managers across the Global Best Practice, Clean Energy Access, and Country Program teams.
  5. Advise CLASP on how to integrate the new approach into a broader organizational M&E and knowledge management system that can be used to consistently track metrics with a relatively low level of effort.
  6. Provide recommendations for metrics besides CO2 and energy savings that CLASP can use to evaluate the success of its programs. To the extent possible, CLASP would like to use common metrics across programs.

Deliverables

The Consultant will be required to provide the following outputs over the course of the project:

  • Participate in project kick off meeting with CLASP within two weeks of project inception;
  • Provide a written report that describes the strengths and weaknesses of the different tools and methods that CLASP has used to calculate energy and CO2 savings from policies and comments on draft results;
  • Provide a written report with actionable recommendations and approximate staff LOE required that can be put in place to enable more consistent measurement of programmatic impacts;
  • Send a bi-weekly summary of activities undertaken as part of this project, via email;
  • Provide timely and detailed responses to questions and comments from CLASP team members related to this project.

Timeline

It is envisioned that this project will commence in February 2016 to be completed by May 2016.  The timeline for the development and implementation of specific deliverables will be coordinated with the selected Contractor for this project.

Selection Criteria

A committee appointed by CLASP will evaluate project and budget proposals received from respondents. The criteria used to determine the winning proposal will include:

  • Relevant qualifications of the project team, including knowledge of and experience working with M&E frameworks and impacts modeling;
  • Expertise in project and organizational planning;
  • Quality of the proposed project design and project management and implementation approach;
  • Understanding of CLASP’s programs and projects; and
  • Total cost of plan.

Proposals will be evaluated using a Quality and Cost-Based Selection (QCBS) method, with weights of 70 percent towards project proposal quality and team and organization experience, and 30 percent towards proposed costs. Additional information about CLASP’s selection process is available here.

All questions may be directed to Jenny Corry Smith at jcorry@clasp.ngo. We request all inquiries be made via e-mail and not by phone.

Application

Companies and organizations that wish to bid on this project must first register as a CLASP Implementing Partner. Registration is easy, and must be completed via the CLASP website before final submittal. 

Applicants are required to submit two separate proposals: a Technical Proposal and a Financial Proposal. The files should be named as per the following example:  “[Contractor Name]_[Technical/Financial] Proposal_RFP [Name]

The Technical Proposal should not exceed 20 pages in length and must include the following elements:

  • Introduction and company profile, including a summary of qualifications related to the assignment [1 to 2 pages];
  • Detailed approach and methodology for implementation and management of the project. Include a description of the role of each team member [2 to 5 pages];
  • Detailed timeline of deliverables and milestones [1 to 2 pages];
  • A summary of qualifications of key personnel relevant to this assignment including a description of the Contractor’s experience with M&E and impacts modeling [2 to 5 pages];
  • Up to three examples of project experience that best illustrate the Contractor’s ability to carry out the project objectives and deliverables [2 to 4 pages]; and

The Financial Proposal must include the following elements:

  • Cost breakdown (in days) of the level of effort and costs for each deliverable and project milestone, associated with each team member that will be engaged in the project.
  • All cost estimates must be in US Dollars.

All proposals must be submitted electronically by January 11, 2016 via the CLASP website using the “Submit Bid” button above and filling out all the requested information. Any proposal not addressing each of the previously mentioned requirements can be considered non-responsive and rejected without further review. Late proposals will be rejected without being considered. Revisions or additions to the proposal will not be accepted after the due date unless specifically invited by CLASP.