In the context of Industry 5.0, predictive maintenance requires models that operate effectively in uncertain and partially observable environments. Traditional deep learning methods for time-series forecasting, such as LSTMs and 1D-CNNs, often struggle with limited interpretability and reduced reliability when dealing with sensor faults. To tackle these issues, we present VisuAlign-RUL, a new multimodal method applied to the NASA C-MAPSS dataset to estimate Remaining Useful Life (RUL). We convert multivariate time-series data into visual forms using Gramian Angular Fields (GAF) and a grid-based spatial fusion technique. This approach allows us to use advanced Computer Vision architectures. The main contribution is a Dual-Stream Contrastive Prognostic Network that aligns raw sensor signals and visual representations in a shared latent space through self-supervised learning. Experimental results show that VisuAlign-RUL achieves an RMSE of 14.05 and an S-Score of 289.63. This performance surpasses supervised Transformers on safety metrics while remaining competitive in accuracy. Additionally, Explainable AI analysis using Grad-CAM reveals that the model independently focuses on thermodynamically linked variables, such as compressor pressures and turbine temperatures. This confirms the physical consistency of the learned features without relying on specific domain rules.

Resilient Prognostics via Multimodal Alignment: A Self-supervised Computer Vision Approach for Time-Series Analysis on Critical Infrastructure / Del Prete, A., Mashaallah, Z., Ciano, C.. - 299:(2026), pp. 174-185. (40th International Conference on Advanced Information Networking and Applications (AINA-2026) ) [10.1007/978-3-032-23335-6_16].

Resilient Prognostics via Multimodal Alignment: A Self-supervised Computer Vision Approach for Time-Series Analysis on Critical Infrastructure

Del Prete A.
Primo
;
Mashaallah Z.;
2026

Abstract

In the context of Industry 5.0, predictive maintenance requires models that operate effectively in uncertain and partially observable environments. Traditional deep learning methods for time-series forecasting, such as LSTMs and 1D-CNNs, often struggle with limited interpretability and reduced reliability when dealing with sensor faults. To tackle these issues, we present VisuAlign-RUL, a new multimodal method applied to the NASA C-MAPSS dataset to estimate Remaining Useful Life (RUL). We convert multivariate time-series data into visual forms using Gramian Angular Fields (GAF) and a grid-based spatial fusion technique. This approach allows us to use advanced Computer Vision architectures. The main contribution is a Dual-Stream Contrastive Prognostic Network that aligns raw sensor signals and visual representations in a shared latent space through self-supervised learning. Experimental results show that VisuAlign-RUL achieves an RMSE of 14.05 and an S-Score of 289.63. This performance surpasses supervised Transformers on safety metrics while remaining competitive in accuracy. Additionally, Explainable AI analysis using Grad-CAM reveals that the model independently focuses on thermodynamically linked variables, such as compressor pressures and turbine temperatures. This confirms the physical consistency of the learned features without relying on specific domain rules.
2026
9783032233349
9783032233356
Resilient Prognostics via Multimodal Alignment: A Self-supervised Computer Vision Approach for Time-Series Analysis on Critical Infrastructure / Del Prete, A., Mashaallah, Z., Ciano, C.. - 299:(2026), pp. 174-185. (40th International Conference on Advanced Information Networking and Applications (AINA-2026) ) [10.1007/978-3-032-23335-6_16].
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11588/1074900
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? ND
social impact