6G experimentation methodologies, pitfalls and best practices
Tuesday, 3 June 2025, 14:00 – 17:30, room 1.E
Organisers:
- Michael Dieudonne (Keysight Technologies Belgium BV, BE)
Motivation and Background
Many different SNS JU projects are or will be running experimentation and measurement campaigns as part of their projects. Experimentation is very useful in a 6G context as it provides insights into the behaviour of a particular technology or the performance of a system for e.g. a given vertical. However, experimentation results are only as good as how well the experimentation is executed.
This workshop gathers the best practices and learnings on experimental methodologies from the active SNS JU projects. The learnings will help the SNS-JU community to consider how they can improve their own future experimentation with as main result an improvement of the value of the collected information.
Failure to apply good methodology can lead to wrong information and conclusions. For this reason, different projects that have built experiments and reflected on the methodology used to execute them are joining forces in this workshop to share their findings and best practices with the community and increase the overall quality of the experimentation execution.
Aspects related to measurement of the overall performance of the system, experimentation, experiment control, calibration, state of the network, measurement calibration, reproducibility, multi-modal data synchronization, controlled experimental conditions to assess KPIs and KVIs, energy measurements will be addressed. The workshop brings together contributions from 6G-SANDBOX, CONVERGE, 6G-XR, SUNRISE-6G, 6G-EWOC, ORIGAMI, EXIGENCE, TRIALSNET, FIDAL.
Structure
14:00 – 15:30: Session 1
- Barrier-driven Performance Evaluation Across Multiple Experimental Platforms, Arifur Rahman, ISRD, results from the ORIGAMI project.
- Approaches on how to calibrate a testbed in an experimental platform, best practices, Michael Dieudonne Keysight Technologies, Coordinator of the 6G-SANDBOX project.
- How to ensure Multi-modal data synchronisation and annotation, Filipe Teixeira from the CONVERGE project.
- Evaluate Intent-Driven Management of Experiments Lifecycle, Kostas Ramantas, Iquadrat partner in the SUNRISE-6G project.
- Methodology for Experiment Lifecycle management, Christos Tranoris, FIDAL project.
- Insight on Data Collection Ontologies for 6G Networks, Mohammed Al-Rawi, University of Aveiro, Technical Coordinator of the 6G-XR project
Coffee break
16:00- 17:15: Session 2
- Insight into a common Data Management Interface to re-use experimental data, Serge Fdida, Sorbonne University, Coordinator of the SLICES RI
- Methodologies for End-to-End Energy Consumption Measurement in 6G, Janez Sterle, Internet Institute, partner in the EXIGENCE project.
- How to have a comprehensive approach to verify Key Performance Indicators (KPI) Across Multiple Demonstrations, José A. Lázaro, UPC, coordinator of the 6G-EWOC project
- Insight into experimental methodologies to assess KVIs, Claudia Chiavarino, Salesian Pontifical University, active in the TRIALSNET project.
17:15- 17:30: Wrap up and conclusion of the workshop
