CONVERGE

Telecommunications and Computer Vision Convergence Tools for Research Infrastructures

The main objective of the CONVERGE project is the development of an innovative toolset aligned with the motto “view-to-communicate and communicate-to-view”. This toolset is a world-first and consists of vision-aided large intelligent surfaces, vision-aided fixed and mobile base stations, a vision-radio simulator and 3D environment modeler. There is also machine learning algorithms used for multimodal data including radio signals, video streams, radio frequency (RF) sensing, and traffic traces.

This toolset will be deployed into 7 research infrastructures (RIs) mostly aligned with the ESFRI Scientific Large-scale Infrastructure for Computing/Communication Experimental Studies (SLICES-RI) to improve their competitiveness.

CONVERGE will also provide the scientific community with open datasets of experimental and simulated data obtained with the toolset in the RIs. They meet scientific and industrial requirements by addressing relevant 6G verticals, enhance the competitiveness of the involved companies, extend the European influence to world-wide recognized RIs, enable the creation of new RIs and contribute to the development of new environment-friendly tools.

The CONVERGE consortium consists of partners and associated partners from the academy and industry. CSC is leading the project data management activities in which a repository-style data handling is implemented, including the handling of metadata as appropriate. This system will provide interfaces for data transfer, for easy search via inventories generated, for data exchange and for data access from computing resources.

CSC is also contributing to defining the access policies for the tools developed by the project. CSC is part of producing electromagnetics augmented 3D environment models for the vision-radio simulator as well as creating the vision-radio simulator for imitating capturing visual information and radio signal propagation. In addition, CSC will be contributing to the toolset integration and to the demonstration of the complete toolset.