Anticipatory evaluation. How to incorporate an anticipatory technique into a theory-driven evaluation process. Results of application in a case study

In recent years, there has been increased focus on strategic learning from impact analysis, including in the field of science, technology, and innovation. In this paper, we propose combining techniques from two fields of study. Firstly, we adopt the approach of addressing impact through productive i...

Full description

Saved in:
Bibliographic Details
Published in:Evaluation and program planning Vol. 108; p. 102509
Main Authors: Pacheco – Troisi, Mariangel, García-Melón, Mónica, Jiménez-Sáez, Fernando
Format: Journal Article
Language:English
Published: Elsevier Ltd 01-02-2025
Subjects:
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In recent years, there has been increased focus on strategic learning from impact analysis, including in the field of science, technology, and innovation. In this paper, we propose combining techniques from two fields of study. Firstly, we adopt the approach of addressing impact through productive interactions between science and society, and secondly, we incorporate an anticipatory dimension by integrating game analysis involving key actors. Through a theory-driven evaluation design, we consider expected impacts as promises of the future. Within an anticipatory perspective, the future can be shaped by the interactions among different actors in the present. In this article, we apply this approach step-by-step to a research institute program in Uruguay. We demonstrate how the achieved results offer strategic insights to the program manager for anticipating and attaining the desired impacts. Additionally, we provide summative inputs for accountability using a flexible technique applicable at any stage of the program life cycle. The article concludes with a discussion of the advantages and disadvantages compared to other techniques, along with lessons learned that may benefit other evaluators seeking to replicate this approach. Furthermore, we explore potential extensions and opportunities for further improvement in this research. •This is a contribution to evaluation practice, resulting from the practice and combination of techniques and research findings from two different fields of study.•A novel approach to apply the concept of productive interactions (PI) in combination with an anticipatory technique implemented in the context of a formative evaluation.•PIs between science and society are a central approach to identify future societal impacts. In this paper we show in detail the individual steps of the application of two concepts: PI and the actor’s game.•An approach that facilitates enables strategic learning through impact analysis, focusing on the connection of the programme with the environment.•Anticipatory evaluation is applicable in a theory-driven evaluation design and offers strategic perspective to project managers and planners.
ISSN:0149-7189
DOI:10.1016/j.evalprogplan.2024.102509