With the increasing popularity of Machine Learning (ML) and, particularly, autoencoder (AE) techniques, it becomes crucial to evaluate the confidence level that can be attributed to the generated results. Psaros et al. [1] provide insightful reviews on Uncertainty Quantification (UQ) methods for deep learning techniques, highlighting persistent challenges in the field. UQ for AEs remains an area with limited coverage in the literature, with Variational AEs [3] being a prevalent approach. The present work operates within the ensemble framework, which have demonstrated exceptional performance in a few studies, yet the relationship between performance, confidence measures, and different uncertainty sources remains unclear. We employ ensembles of convolutional AEs for predicting flow fields around wing sections [2]; demonstrating the ability of AE ensemble to effectively discriminates between diverse sources of uncertainty: internal (model-form) and external uncertainties. The former is due to limited or noisy data, hyperparameters choices and network architecture, while the latter is a consequence of limited knowledge of the operating conditions in the prediction scenario. Our approach yields predictions with confidence intervals accurately reflecting the relative importance of various sources of uncertainty. Additionally, the standard deviation of the ensemble’s predictions proves to be a reasonable proxy for actual error, a crucial feature for the safe integration of ML algorithms into real-world applications. Results obtained from the ensemble of AEs are compared with those derived from Gaussian Process Regression, showcasing distinctions and highlighting the superior capability of AEs in discerning high- and low-confidence prediction scenarios in the absence of ground truth data.
Aerodynamic predictions under uncertainty using Autoencoders / Saetta, Ettore; Tognaccini, Renato; Iaccarino, Gianluca. - (2024). (Intervento presentato al convegno 9th European Congress on Computational Methods in Applied Sciences and Engineering tenutosi a Lisbona nel 3-7 June 2024).
Aerodynamic predictions under uncertainty using Autoencoders
Ettore Saetta
Primo
;Renato TognacciniSecondo
;
2024
Abstract
With the increasing popularity of Machine Learning (ML) and, particularly, autoencoder (AE) techniques, it becomes crucial to evaluate the confidence level that can be attributed to the generated results. Psaros et al. [1] provide insightful reviews on Uncertainty Quantification (UQ) methods for deep learning techniques, highlighting persistent challenges in the field. UQ for AEs remains an area with limited coverage in the literature, with Variational AEs [3] being a prevalent approach. The present work operates within the ensemble framework, which have demonstrated exceptional performance in a few studies, yet the relationship between performance, confidence measures, and different uncertainty sources remains unclear. We employ ensembles of convolutional AEs for predicting flow fields around wing sections [2]; demonstrating the ability of AE ensemble to effectively discriminates between diverse sources of uncertainty: internal (model-form) and external uncertainties. The former is due to limited or noisy data, hyperparameters choices and network architecture, while the latter is a consequence of limited knowledge of the operating conditions in the prediction scenario. Our approach yields predictions with confidence intervals accurately reflecting the relative importance of various sources of uncertainty. Additionally, the standard deviation of the ensemble’s predictions proves to be a reasonable proxy for actual error, a crucial feature for the safe integration of ML algorithms into real-world applications. Results obtained from the ensemble of AEs are compared with those derived from Gaussian Process Regression, showcasing distinctions and highlighting the superior capability of AEs in discerning high- and low-confidence prediction scenarios in the absence of ground truth data.I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.