This paper makes a compelling case for the adoption of the recently proposed Data Mesh architecture within IoT–Edge–Cloud Continuum scenarios, particularly in the context of Intelligent Transportation Systems and Data driven Mobility Services. Unlike centralized cloud-based approaches, based on data warehouses/lakes connected with ETL (Extract, Transform, and Load) pipelines, Data Mesh promotes a decentralized data ownership model which brings several advantages in addressing open challenges in IoT–Edge–Cloud Continuum scenarios. First, we present an overview of the Data Mesh concepts, and how they advance the state of the art in data management architectures. Secondly, we discuss how their adoption might ease the development of IoT–Edge–Cloud applications in terms of: (i) hiding the heterogeneity of the IoT Layer, (ii) mitigating latency by enabling full domain migrations, and (iii) promoting the adoption of AI techniques, such as MLOps and Federated Learning at the edge of the network. Finally, we provide practical guidelines for implementing such an architecture to enhance the safety of pedestrians and vulnerable users, based on our experience with the Modena Automotive Smart Area.
Rossini, E., Bicocchi, N., Hadjidimitriou, N., Pietri, M., Picone, M., Mamei, M., Towards a Distributed Data Mesh Model for the IoT-Edge-Cloud Continuum in Smart Cities, in IEEE/ACM Symposium on Edge Computing (SEC), (Roma, 04-07 December 2024), IEEE, Roma 2024: 383-388. [10.1109/SEC62691.2024.00041] [https://hdl.handle.net/10807/339459]
Towards a Distributed Data Mesh Model for the IoT-Edge-Cloud Continuum in Smart Cities
Hadjidimitriou, Natalia;
2024
Abstract
This paper makes a compelling case for the adoption of the recently proposed Data Mesh architecture within IoT–Edge–Cloud Continuum scenarios, particularly in the context of Intelligent Transportation Systems and Data driven Mobility Services. Unlike centralized cloud-based approaches, based on data warehouses/lakes connected with ETL (Extract, Transform, and Load) pipelines, Data Mesh promotes a decentralized data ownership model which brings several advantages in addressing open challenges in IoT–Edge–Cloud Continuum scenarios. First, we present an overview of the Data Mesh concepts, and how they advance the state of the art in data management architectures. Secondly, we discuss how their adoption might ease the development of IoT–Edge–Cloud applications in terms of: (i) hiding the heterogeneity of the IoT Layer, (ii) mitigating latency by enabling full domain migrations, and (iii) promoting the adoption of AI techniques, such as MLOps and Federated Learning at the edge of the network. Finally, we provide practical guidelines for implementing such an architecture to enhance the safety of pedestrians and vulnerable users, based on our experience with the Modena Automotive Smart Area.I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.



