Objective and Subjective Approaches to Key Value Indicators – Sharing methodological approaches and evaluation instruments – 6G4Society & TrialsNet Workshop

What
Workshop based in two parts. The first half is presentations from SNS JU projects and external experts. The second half is based on interactive dialogue and active contributions from participants.

Who
SNS JU Projects working on KVIs

Date & Time
6 February 2025, 10:00-12:20 CET

Introduction

As KVIs become further developed and integrated as key components of SNS JU projects, challenges have emerged around how to identify what is a good measure of a KV, and how these can look different for subjective and objective evaluations. Key to this is understanding how these approaches and instruments can be different from KPIs and what other methodological resources can be drawn upon in their development. The aim of this workshop is twofold. First, it will share different approaches being developed in SNS JU projects as well as approaches used by external experts who also pursue indicators of social and sustainability values. Second, it will break the participants into small groups to work together to explore how what was presented can inform their diverse projects. The idea is to blend expert knowledge with interactive dialogues between SNS projects that are actively working on KVIs.

Objectives

• Gather examples of how social and sustainability values can be assessed and evaluated from projects and external experts.
• Explore approaches that look beyond technical KPIs and consider non-technical evaluations of value.
• Improve our understanding and capacity to address these value outcomes in practical terms, using existing resources.

Agenda

• Introduction
• Part 1 (1h35min): Exploration of subjective and objective approaches to social value that expand the repertoire and skills of projects applying KVIs, focusing on areas in which projects have expressed challenges.
• 30 min: Practical examples of subjective and objective KVIs for social and sustainability values from the SNS projects, TRIALSNET, ORIGAMI, DETERMINISTIC-6G, FIDAL.
• 50 min: Two approaches to identifying and applying social value indicators from External Experts in the field.
  • Yulia Romaschenko, Technical Director, Social Value international
  • Emad Yaghmaei, Senior Researcher at TU Delft & Founder, & Rie Larsen, Researcher and Strategic Advisor, YAGHMA
• 15 Min: Q&A

• Part 2 (45 minutes): Interactive activity that builds on what was presented and explores how these can become useful in projects.
• 25 min: MIRO-based hands-on small group activity to engage themes and processes presented in the part 1 to develop concept maps that chart rationale between value for investigation, research question that drives the indicator, and results that can be gathered. Participants will be allocated to small breakout groups with a moderator who will guide the activity based on group dynamics and discussions.
• 20 min: Q&A, with guest expert in social value analysis and indicators, Tim Goodspeed, to ask questions and help prompt, push, confirm and challenge our ideas.

25 min: MIRO-based hands-on small group activity to engage themes and processes presented in the part 1 to develop concept maps that chart rationale between value for investigation, research question that drives the indicator, and results that can be gathered. Participants will be allocated to small breakout groups with a moderator who will guide the activity based on group dynamics and discussions.20 min: Q&A, with guest expert in social value analysis and indicators, Tim Goodspeed, to ask questions and help prompt, push, confirm and challenge our ideas. 

Outcomes

A short report highlighting trends within projects, best practices, and gaps that need addressing. These outcomes will continue to inform the work on KVIs and Sustainability.

Preparation Before Workshop

We will send out a small set of discussion points to come prepared to consider and a short poll to organise contributions and gather insights more effectively. 

Target audience

This is primarily for SNS JU projects working on KVIs. We welcome all interested participants to join us in this workshop. We greatly encourage those responsible for KVI development within SNS projects to participate during the breakout sessions to contribute to a rich and productive discussion output. 

Sign up for the webinar here!