16 papers · ranked by Valyu relevance
Peter I. Frazier
Bayesian optimization is an approach to optimizing objective functions that take a long time (minutes or hours) to evaluate. It is best-suited for optimization over continuous domains of less than 20 dimensions, and tolerates stochastic noise in function evaluations. It builds a surrogate for the objective and…
Rubén Martínez-Cantín
BayesOpt is a library with state-of-the-art Bayesian optimization methods to solve nonlinear optimization, stochastic bandits or sequential experimental design problems. Bayesian optimization is sample efficient by building a posterior distribution to capture the evidence and prior knowledge for the target function.…
Eduardo C. Garrido‐Merchán
Several scenarios require the optimization of non-convex black-box functions, that are noisy expensive to evaluate functions with unknown analytical expression, whose gradients are hence not accessible. For example, the hyper-parameter tuning problem of machine learning models. Bayesian optimization is a class of…
Antoine Blanchard, Themistoklis P. Sapsis
In Bayesian optimization, accounting for the importance of the output relative to the input is a crucial yet challenging exercise, as it can considerably improve the final result but often involves inaccurate and cumbersome entropy estimations. We approach the problem from the perspective of importance-sampling theory…
Roi Naveiro, Becky Tang
Bayesian Optimization (BO) is a powerful method for optimizing black-box functions by combining prior knowledge with ongoing function evaluations. BO constructs a probabilistic surrogate model of the objective function given the covariates, which is in turn used to inform the selection of future evaluation points…
Xilu Wang, Yaochu Jin, Sebastian Schmitt, Markus Olhofer
Bayesian optimization has emerged at the forefront of expensive black-box optimization due to its data efficiency. Recent years have witnessed a proliferation of studies on the development of new Bayesian optimization algorithms and their applications. Hence, this paper attempts to provide a comprehensive and updated…
Abhilash Nandy, Chandan Kumar‐Sinha, Deepak Mewada, Soumya Sharma
In this report we survey Bayesian Optimization methods focussed on Multi-Armed Bandit Problem. We take the help of the paper "Portfolio Allocation for Bayesian Optimization" [1]. We report a small literature survey on the acquisition functions and the types of portfolio strategies used in the papers [1] [2]. We also…
Doniyor Ulmasov, Caroline Baroukh, Benoît Chachuat, Marc Peter Deisenroth + 1 more
'Marc Peter Deisenroth' 'Ruth Misener'] Bayesian Optimization (BO) is a data-efficient method for global black-box optimization of an expensive-to-evaluate fitness function. BO typically assumes that computation cost of BO is cheap, but experiments are time consuming or costly. In practice, this allows us to optimize…
Dipti Jasrasaria, Edward O. Pyzer‐Knapp
—Bayesian optimization offers the possibility of optimizing black-box operations not accessible through traditional techniques. The success of Bayesian optimization methods such as Expected Improvement (EI) are significantly affected by the degree of trade-off between exploration and exploitation. Too much exploration…
Ziyu Wang, Frank Hutter, Masrour Zoghi, David S. Matheson + 1 more
'Nando De Feitas'] | Ziyu Wang | ziyu.wang@cs.ox.ac.uk | | --- | --- | | Department of Computer Science, University of Oxford | | | Frank Hutter | fh@cs.uni-freiburg.de | | Department of Computer Science, University of Freiburg | | | Masrour Zoghi | m.zoghi@uva.nl | | Department of Computer Science, University of…
Ashish Anil Pawar, Ujwal Warbhe
Bayesian Optimization is an effective method for searching the global maxima of an objective function especially if the function is unknown. The process comprises of using a surrogate function and choosing an acquisition function followed by optimizing the acquisition function to find the next sampling point. This…
Trung Le, Khanh Nguyen, Tu Dinh Nguyen, Dinh Phung
Some real-world problems revolve to solve the optimization problem max x∈X f ( x ) where f ( . ) is a black-box function and X might be the set of non-vectorial objects (e.g., distributions) where we can only define a symmetric and non-negative similarity score on it. This setting requires a novel view for the standard…
Pushparaja Murugan
Convolutional Neural Network is known as ConvNet have been extensively used in many complex machine learning tasks. However, hyperparameters optimization is one of a crucial step in developing ConvNet architectures, since the accuracy and performance are totally reliant on the hyperparameters. This multilayered…
Loc Nguyen, Michael A. Osborne
Bayesian optimization has demonstrated impressive success in finding the optimum input x ∗ and output f ∗ = f(x ∗ ) = max f(x) of a black-box function f . In some applications, however, the optimum output f ∗ is known in advance and the goal is to find the corresponding optimum input x ∗ . In this paper, we consider a…
Rubén Martínez-Cantín
— Active policy search combines the trial-and-error methodology from policy search with Bayesian optimization to actively find the optimal policy. First, policy search is a type of reinforcement learning which has become very popular for robot control, for its ability to deal with complex continuous state and action…
Tony Wu, Daniel Flam-Shepherd, Alán Aspuru–Guzik
This paper focuses on Bayesian Optimization in combinatorial spaces. In many applications in the natural science. Broad applications include the study of molecules, proteins, DNA, device structures and quantum circuit designs, a on optimization over combinatorial categorical spaces is needed to find optimal or…