Evaluating energy efficiency policy: understanding the ‘energy policy epistemology’ may explain the lack of demand for randomised controlled trials

Cooper, Adam

doi:10.1007/s12053-018-9618-8

Cited by 9 publications

(5 citation statements)

References 15 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The making use of evaluation results, moreover, hinges upon the timing of the evaluation, especially so in a policy field like energy efficiency that is rapidly developing [51]. As such, the design of the evaluation should mirror the timeframe of the use, where more rapidly executed evaluations may be favourable over more extensive ones at certain occasions, and vice versa.…”

Section: Use Of Evaluationsmentioning

confidence: 99%

Transition governance for energy efficiency - insights from a systematic review of Swedish policy evaluation practices

2019

View full text Add to dashboard Cite

Background: The transition towards a more sustainable energy system is urgent for addressing global environmental and social challenges, and will require transformative changes including improved energy efficiency in the built environment. To reach identified efficiency potentials, various policy instruments have been introduced but their effects are often unclear. In this paper, we argue that the outline of transformative policy strategies will require well-designed evaluations. The objective is to present a theory-based evaluation framework that can be used to assess existing evaluations, in order to support transformative policy strategies. The framework is also applied to provide insights from current Swedish evaluation practices. Methods: The theory-based evaluation framework presented builds on evaluation theory, policy analysis and transition research and is arranged around methods, value judgements and use of the evaluations. Moreover, key aspects from transition research are included to provide guidance for transformative efforts in the evaluations. The systematic review presented in the paper is qualitative, covering 33 policy evaluations for energy efficiency in buildings in Sweden, commissioned by Swedish governmental authorities over a decade. Results: The results of the review reveal a wide range of evaluations undertaken, using a sound methodological evaluation base that builds on a variety of methods for analysis, and application of multi-criteria analyses. Commonly, however, a rather narrow scope was applied and we note a missed opportunity for triangulation of findings. Key aspects for capturing transformative efforts, such as system-, scale-and multi-actor approaches, as well as visioning, experimentation and learning, were considered to varying extents, but could be more explicit and elaborate. Conclusion: In all, we find the proposed theory-based evaluation framework useful for assessing and discussing both robustness and transformative efforts of current policy and evaluation practices. The review of the Swedish policy evaluations further indicates sound evaluation practices, and a foundational structure for identifying and analysing transformative efforts. To fully support transformative changes, we suggest a wider system perspective and a more thorough multi-actor approach and actor involvement in the evaluations. We also stress the need to further link evaluation theory with transition research to design evaluations that can support transformative changes in society.

show abstract

Section: Use Of Evaluationsmentioning

confidence: 99%

Transition governance for energy efficiency - insights from a systematic review of Swedish policy evaluation practices

2019

View full text Add to dashboard Cite

show abstract

“…As energy resources have appeared more and more precarious, new SSH disciplines have added their respective approaches and bodies of knowledge, creating a heterogeneous group, which addresses energy efficiency from different angles. Today, SSH researchers also help to increase energy efficiency by studying what people and institutions know and do-including those who are tasked with implementing energy efficiency (Cooper, 2018)-as well as reflecting critically on SSH's ability to engage with energy as a technical entity and exploring what changing a society's relationship to energy means in more fundamental terms (Love and Cooper, 2015;Cooper, 2017).…”

Section: Background Context: the Evolution Of Social Sciences And Hum...mentioning

confidence: 99%

An agenda for future Social Sciences and Humanities research on energy efficiency: 100 priority research questions

Foulds

Royston

Berker

et al. 2022

Humanit Soc Sci Commun

View full text Add to dashboard Cite

Decades of techno-economic energy policymaking and research have meant evidence from the Social Sciences and Humanities (SSH)—including critical reflections on what changing a society’s relation to energy (efficiency) even means—have been underutilised. In particular, (i) the SSH have too often been sidelined and/or narrowly pigeonholed by policymakers, funders, and other decision-makers when driving research agendas, and (ii) the setting of SSH-focused research agendas has not historically embedded inclusive and deliberative processes. The aim of this paper is to address these gaps through the production of a research agenda outlining future SSH research priorities for energy efficiency. A Horizon Scanning exercise was run, which sought to identify 100 priority SSH questions for energy efficiency research. This exercise included 152 researchers with prior SSH expertise on energy efficiency, who together spanned 62 (sub-)disciplines of SSH, 23 countries, and a full range of career stages. The resultant questions were inductively clustered into seven themes as follows: (1) Citizenship, engagement and knowledge exchange in relation to energy efficiency; (2) Energy efficiency in relation to equity, justice, poverty and vulnerability; (3) Energy efficiency in relation to everyday life and practices of energy consumption and production; (4) Framing, defining and measuring energy efficiency; (5) Governance, policy and political issues around energy efficiency; (6) Roles of economic systems, supply chains and financial mechanisms in improving energy efficiency; and (7) The interactions, unintended consequences and rebound effects of energy efficiency interventions. Given the consistent centrality of energy efficiency in policy programmes, this paper highlights that well-developed SSH approaches are ready to be mobilised to contribute to the development, and/or to understand the implications, of energy efficiency measures and governance solutions. Implicitly, it also emphasises the heterogeneity of SSH policy evidence that can be produced. The agenda will be of use for both (1) those new to the energy-SSH field (including policyworkers), for learnings on the capabilities and capacities of energy-SSH, and (2) established energy-SSH researchers, for insights on the collectively held futures of energy-SSH research.

show abstract

“…More research is also needed on other building EEMs, as a recent evidence gap map found that few studies examine government, public or commercial buildings (Berretta et al, 2021). There is debate about the barriers to randomised evaluations in the energy efficiency space (Cooper, 2018; Vine et al, 2014). Even when randomised evaluations are not feasible, natural experiments and quasi‐experimental methods can provide useful causal evidence (Cooper, 2018).…”

Section: Authors' Conclusionmentioning

confidence: 99%

“…There is debate about the barriers to randomised evaluations in the energy efficiency space (Cooper, 2018 ; Vine et al, 2014 ). Even when randomised evaluations are not feasible, natural experiments and quasi‐experimental methods can provide useful causal evidence (Cooper, 2018 ).…”

Section: Authors' Conclusionmentioning

confidence: 99%

Residential energy efficiency interventions: A meta‐analysis of effectiveness studies

Berretta¹,

Furgeson²,

Wu³

et al. 2021

Campbell Systematic Reviews

View full text Add to dashboard Cite

Background: The residential sector releases around 17% of global greenhouse gas emissions and making residential buildings more energy efficient can help mitigate climate change. Engineering models are often used to predict the effects of residential energy efficiency interventions (REEI) on energy consumption, but empirical studies find that these models often over-estimate the actual impact of REEI installation. Different empirical studies often estimate different impacts for the same REEI, possibly due to variations in implementation, climate and population. Funding for this systematic review was provided by the evaluation function at the European Investment Bank Group.Objectives: The review aims to assess the effectiveness of installing REEIs on the following primary outcomes: energy consumption, energy affordability, CO 2 emissions and air quality indices and pollution levels.

show abstract

Evaluating energy efficiency policy: understanding the ‘energy policy epistemology’ may explain the lack of demand for randomised controlled trials

Cited by 9 publications

References 15 publications

Transition governance for energy efficiency - insights from a systematic review of Swedish policy evaluation practices

Transition governance for energy efficiency - insights from a systematic review of Swedish policy evaluation practices

An agenda for future Social Sciences and Humanities research on energy efficiency: 100 priority research questions

Residential energy efficiency interventions: A meta‐analysis of effectiveness studies

Contact Info

Product

Resources

About