Examples of success criteria, indicators and baselines for ...



Examples of success criteria, indicators and baselines for different types of projects

Contents

1. Energy audits

2. Energy advice

3. Financial support and services

4. Information and education campaigns

5. Metering and feedback

6. Voluntary programmes and commitments

Notes concerning the tables

Your project may have other success criteria than those exemplified here. Examples of other success criteria can include particular social goals like reduction of fuel poverty or stimulation of employment in a certain region. Please take these examples as indicative only. For further reading and more indicators, we recommend the following references and sites:

• IEA DSM Evaluation Guidebook, Volume 1 ()

• Changing Energy Behaviour: Guidelines for Behavioural Change Programmes ()

• AID-EEE Guidelines for the monitoring, evaluation and design of energy efficiency policies (http:// )

It may be difficult to define baselines for many of the indicators, and all projects cannot afford to conduct baseline studies. Depending on your resources and the expectations of your funding bodies, you may consider using ‘proxy data’ for baselines like:

• national and regional statistics

• existing general knowledge, attitude and behaviour surveys in your country

• expert interviews on the current status at the start of the project

• survey with small, random sample of target group

• available default data from existing CO2 tools or existing data on the specific consumption of various appliances

|1. Energy audits: examples of success criteria, indicators, baselines and ways to measure |

|Possible success criteria |Possible indicators |Possible baselines |How to measure |

|Increased customer awareness of energy use |Number of audits conducted (or share of audited facilities in a sector) |Depends on target group: maybe ‘0’, maybe people |Counts and records of audits |

| | |already had one: find out via survey? | |

|Increased customer awareness of energy use |Attention to and use of audits/ Number of investments made |Depends on target group: maybe ‘0’, maybe people |Number of changes implemented, Number / |

| | |already had one: find out by means of survey? (to|amount of investments made |

| | |test for additionality, find out plans of | |

| | |investments/changes before the project) |Amount of energy use |

|Reduced energy consumption |Savings potential – what measures have been identified and the savings |Energy consumption before audit |Estimation of savings during planning |

| |in energy and corresponding financial costs and savings | |phase of project and evaluation of |

| |Theoretical savings potentials of implemented measures – what measures |(Default data from statistics) |savings after implementation of measures |

| |have been undertaken and estimate of energy savings thus achieved | | |

| |Measured savings at the site level – shows whether implemented measures | | |

| |actually reduce the energy consumption as expected | | |

| |Verified results – usually a statistical study of results of implemented| | |

| |measures | | |

| |Number of new energy management practices adopted (self-reported |Existing level of investments, practices or |Survey, measurements of energy |

| |behaviour) |energy consumption |consumption |

|Customers & stakeholders: overall |Customer & stakeholder survey: overall satisfaction (project, process, |Customer & stakeholder expectations |Survey including customer ratings (and |

|satisfaction with the programme |outcomes) | |qualitative data) |

|2. Energy advice: examples of success criteria, indicators, baselines and ways to measure |

|Possible success criteria |Possible indicators |Possible baselines |How to measure |

|Reaching a large number of people |Number of advice contacts, number of people attending events |Available advice at the start of the project |Keeping count and records of customer |

| | | |contacts |

|Mapping problems and offering suitable |Relevance to recipients/participants |Status of know-how /information of participants |(Satisfaction) survey using quantitative |

|solutions | | |and qualitative data |

|Promotion of energy efficiency investments |Share of new investments generated as a result of the advice[1] among |Level of f energy investments at the start of the|Records of number and amount of |

|and improved energy management practices |those receiving advice |project |investments |

| |Share of advice recipients reporting new practices |Status of recipients’ practices at the start of |Survey, self-reported behaviour |

| | |the project | |

|Increased customer awareness and competency,|Knowledge tests |Baseline customer survey: knowledge and practices|Customer surveys/interviews comparing |

|capacity to advise others |Self-reports of new practices (also changes in physical environment that|at the start of the project |knowledge and practices before/after |

| |allow new practices) | |project |

|Customers: lower energy bills, improved |Customer satisfaction with the outcomes of the project |Customer expectations |Customer survey |

|comfort, convenience | | | |

|Customers & stakeholders: overall |Overall satisfaction (project, process, outcomes) |Customer & stakeholder expectations |Survey |

|satisfaction with the programme | | | |

|3. Financial support and services: examples of success criteria, indicators, baselines and ways to measure |

|Possible success criteria |Possible indicators |Possible baselines |How to measure |

|Promotion of energy efficiency investments |Number or share of customers making use of |Number at start of initiative |Customer contacts and records |

| |support/service |Level of investments at the start of the initiative | |

| | | | |

| |Number/value of investments made | | |

|Energy savings from the measures applied |Energy consumption compared to baseline |Figures on the total consumption of electricity or heat / |kWh consumption, gas/oil consumption |

| | |figures on specific consumption of appliances |Audit/analysis |

|Promotion of low-carbon solutions: e.g. appliances,|Increase in the adoption/market share of low-carbon |Adoption/market share of low-carbon solutions at the start of |Sales statistics, market share |

|technology, systems of provisions, behavior options|solutions |the project |statistics? |

| | |CO2 profile |Carbon footprint of households or |

| | | |enterprises |

|Cost-effectiveness |Money and other resources used/energy or CO2 |Comparison to other projects/programmes with the same goal |Net Present Value of programme impacts |

| |emissions saved | |i.e., a sum of the benefits of the |

| | | |programme during its effective period |

| | | |divided by the costs of the programme |

| | | |plus the cost of capital (interest rate) |

|Customers: improved comfort, convenience |Experience of improved comfort, convenience |Baseline assessment (pre-project survey) of current feeling of |Survey /questionnaire on qualitative data|

| | |comfort and convenience | |

|Customers: lower energy bills, |kWh used per month/per year, |Monthly energy (or yearly average) of energy used before start |Check bills, but take into account: free |

| | |of project, statistics/old bills before measures taken |rider or ‘deadweight’ effects, rebound |

| | | |effect |

|Customers & stakeholders: overall satisfaction with|Experience overall of satisfaction (project, process,|Customer & stakeholder expectations |Customer & stakeholder survey |

|the project |outcomes) | | |

|4. Information and educations campaigns: examples of success criteria, indicators, baselines and ways to measure |

|Possible success criteria |Possible indicators |Possible baselines |How to measure |

|Reaching a particular audience with the intended |Products delivered by the campaign, media & partners |Amount and quality of information existing |Number of newspaper/online items, number |

|message |involved, number of people exposed to the message | |of readers, clicks on webpage |

|Changes in awareness, knowledge, attitudes and |Changes in awareness, knowledge attitudes |Pre-project survey on the level and quality of consumer’s |Survey, self-report on awareness, |

|internalised norms (i.e., what people feel they | |knowledge and skills |attitude; information |

|should do) | | | |

| |Increased information search on energy-efficient |Pre-project sales statistics on energy efficient products, |Sales statistics/market share |

| |products |interviews with salespersons |information/ information from appliance |

| |Awareness of energy efficient products and changes in| |shops |

| |future decision-making processes | | |

|Changes in behaviour |Self-reported behaviour |Pre-project survey |Survey, self-reports e.g. via energy |

| | | |diary |

|5. Metering and feedback: examples of success criteria, indicators, baselines and ways to measure |

|Possible success criteria |Possible indicators |Possible baselines |How to measure |

|Increased customer awareness of energy use |Attention to and use of feedback – self-report from |Pre-project survey: check of current awareness and use of |Comparison of awareness before/after |

| |survey |feedback (if any) |project on the basis of surveys |

|Reduced energy use |Changes in energy use after feedback |Energy use before provision of feedback |kWh/gas/oil consumption |

|Overall satisfaction with the project (e.g. the |Customer survey: overall satisfaction (project, |Customer expectations |Customer/stakeholder survey |

|extent to which it is perceived of as useful and |process, outcomes) | | |

|interesting by the recipients) | | | |

|6. Voluntary programmes and commitments: examples of success criteria, indicators, baselines and ways to measure |

|Possible success criteria |Possible indicators |Possible baselines |How to measure |

|Getting energy users ‘on board’ |Number of participants |Number before project |Participant count |

|Supporting change |Number of participants receiving training etc. |Number before project |Participant count |

|Improvements made |Number of improvements made |Number before project |Counting and keeping records of |

| | | |improvements made |

|Energy conservation, CO2 reductions in target group|Changes in energy consumption, calculated CO2 |Energy consumption (CO2 emissions) when joining the project |kWh/gas /oil consumption – resulting |

| |emissions |Default data form statistics/calculations |emissions |

| | | |Carbon footprint of household /enterprise|

|Customers & stakeholders: overall satisfaction with|Overall satisfaction (project, process, outcomes) |Customer & stakeholder expectations |Customer & stakeholder survey on |

|the programme | | |willingness to participate again / to |

| | | |realize the recommendations |

-----------------------

[1] Especially for larger investments, it is not likely that all investments made within the target group are directly due to the advice. People considering an investment are more likely to seek advice. Thus, it is necessary to find out how many of the customers would have made the investment even without the advice.

................
................

In order to avoid copyright disputes, this page is only a partial summary.

Google Online Preview   Download