A relations-based evaluation framework to support collaborative research and innovation (R&I) networks

Abstract

The majority of the projects funded under the European Research Framework Programme (FP) require a collaborative effort in order to tackle complex societal challenges. The underlying assumption is that collaborative networks boost research productivity and the attainment of the goals set out by the European Commission's agenda. In general, the production of scientific knowledge increasingly takes place within networks and consortia with a wide diversity and interlinkages of disciplines, expertise, backgrounds and approaches. This relational dimension has become even more important in the Horizon Europe FP, which has moved from a project-focused to a mission-oriented approach whereby a portfolio of projects is managed in coordination in order to stimulate cross-learning and experimentation. Starting from key concepts and theories of evaluation research, including ten years of experience for the Italian National Research Council (CNR) team as an internal evaluator, we are proposing a new approach, namely a Relations-based Evaluation (RE) approach, that analyses, assesses and builds relationships, both internal and external, with the ultimate aim of supporting collaborative research and innovation (R&I) projects. The framework originated within the context of EU projects and deals with the specific case of consortia funded under the EU FPs. However, it could be easily applied to other types of research consortia and project networks with similar features.

Keywords:

• Relations-based evaluation
• collaborative R&Inetworks
• EU research framework programme
• relational dimension‌
• Research and Innovation ‌projects

Acknowledgements

We wish to acknowledge the support received in elaborating this work provided by a number of colleagues and experts. Sveva Avveduto and Daniela Luzi (National Research Council, Italy) have been the founders the CNR evaluation experience. Many of the ideas and insights presented in this paper have been shared and discussed in detail with both. The proposed framework would not have seen the light without their invaluable encouragements. We are grateful for the support received by our colleague Cristiana Crescimbene (National Research Council, Italy) who patiently drew the paper's figures. Prof. Joe Cannataci (University of Malta) and prof. Jeanne Mifsud Bonnici (University of Groningen) have been outstanding EU project coordinators and have supported the CNR evaluation team's methodology and approach for a decade. If the Relations-based Evaluation approach will catch on in future EU Research & Innovation consortia, it will be also thanks to their inclusive and open leadership. We wish to thank our former Director at CNR, Daniele Archibugi, for his text revisions’ and for the fruitful discussion around the EU research funding mechanism and its evaluation.

Disclosure statement

No potential conflict of interest was reported by the author(s).