Logo image
Bayesian optimization with informative parametric models via sequential Monte Carlo
Journal article   Open access   Peer reviewed

Bayesian optimization with informative parametric models via sequential Monte Carlo

Rafael Oliveira, Richard Scalzo, Robert Kohn, Sally Cripps, Kyle Hardman, John Close, Nasrin Taghavi and Charles Lemckert
DATA-CENTRIC ENGINEERING, Vol.3, e5
08/03/2022
pdf
Bayesian optimization with informative parametric models1.16 MBDownloadView
Published (Version of record)CC BY V4.0 Open Access
url
Bayesian optimization with informative parametric modelsView
Published (Version of record)CC BY V4.0 Open

Related links

Metrics

2 File views/ downloads
108 Record Views

Abstract

Computer Science Computer Science, Artificial Intelligence Computer Science, Interdisciplinary Applications Engineering Engineering, Multidisciplinary Science & Technology Technology
Bayesian optimization (BO) has been a successful approach to optimize expensive functions whose prior knowledge can be specified by means of a probabilistic model. Due to their expressiveness and tractable closed-form predictive distributions, Gaussian process (GP) surrogate models have been the default go-to choice when deriving BO frameworks. However, as nonparametric models, GPs offer very little in terms of interpretability and informative power when applied to model complex physical phenomena in scientific applications. In addition, the Gaussian assumption also limits the applicability of GPs to problems where the variables of interest may highly deviate from Gaussianity. In this article, we investigate an alternative modeling framework for BO which makes use of sequential Monte Carlo (SMC) to perform Bayesian inference with parametric models. We propose a BO algorithm to take advantage of SMC's flexible posterior representations and provide methods to compensate for bias in the approximations and reduce particle degeneracy. Experimental results on simulated engineering applications in detecting water leaks and contaminant source localization are presented showing performance improvements over GP-based BO approaches.

Details

Logo image