14 papers · ranked by Valyu relevance
Mark Amo-Boateng
—This article presents the novel breakthrough general purpose algorithm for very large-scale optimization problems. The novel algorithm is capable of achieving breakthrough speeds for very large-scale optimization on general purpose laptops and embedded systems. Application of the algorithm to the Griewank function was…
Weiwei Fan, L. Jeff Hong, Guangxin Jiang, Jun Luo
Large-scale simulation optimization (SO) problems encompass both large-scale ranking-and-selection problems and high-dimensional discrete or continuous SO problems, presenting significant challenges to existing SO theories and algorithms. This paper begins by providing illustrative examples that highlight the…
Haowei Wang, Ercong Zhang, Szu Hui Ng, Giulia Pedrielli
Bayesian optimization (BO) has been widely used in machine learning and simulation optimization. With the increase in computational resources and storage capacities in these fields, high-dimensional and large-scale problems are becoming increasingly common. In this study, we propose a model aggregation method in the…
Wang, Maoran, Xingju Cai, Yongxin Chen
This paper investigates the problems large-scale distributed composite convex optimization, with motivations from a broad range of applications, including multi-agent systems, federated learning, smart grids, wireless sensor networks, compressed sensing, and so on. Stochastic gradient descent (SGD) and its variants are…
Hardik Tankaria, Shinji SUGIMOTO, Nobuo Yamashita
The limited memory BFGS (L-BFGS) method is one of the popular methods for solving large-scale unconstrained optimization. Since the standard L-BFGS method uses a line search to guarantee its global convergence, it sometimes requires a large number of function evaluations. To overcome the difficulty, we propose a new…
Abdullah Al-Dujaili, Suresh Sundaram
Random embedding has been applied with empirical success to large-scale black-box optimization problems with low effective dimensions. This paper proposes the EM B E D D E DHU N T E R algorithm, which incorporates the technique in a hierarchical stochastic bandit setting, following the optimism in the face of…
Yang You, Yuhui Wang, Huan Zhang, Zhao Zhang + 2 more
'Cho‐Jui Hsieh'] Large-batch training is an efficient approach for current distributed deep learning systems. It has enabled researchers to reduce the ImageNet/ResNet-50 training time from 29 hours to around 1 minute. In this paper, we focus on studying the limit of the batch size. We think it may provide a guidance to…
Ricardo Di Pasquale, Javier Marenco
— This paper reviews recent advances in big data optimization, providing the state-of-art of this emerging field. The main focus in this review are optimization techniques being applied in big data analysis environments. Integer linear programming, coordinate descent methods, alternating direction method of…
Ziyu Wang, Frank Hutter, Masrour Zoghi, David S. Matheson + 1 more
'Nando De Feitas'] | Ziyu Wang | ziyu.wang@cs.ox.ac.uk | | --- | --- | | Department of Computer Science, University of Oxford | | | Frank Hutter | fh@cs.uni-freiburg.de | | Department of Computer Science, University of Freiburg | | | Masrour Zoghi | m.zoghi@uva.nl | | Department of Computer Science, University of…
Hauke F. Maathuis, Roeland De Breuker, Saullo G. P. Castro
Latent Space Gaussian Processes Authors: ['Hauke F. Maathuis' 'Roeland De Breuker' 'Saullo G. P. Castro'] Design optimisation offers the potential to develop lightweight aircraft structures with reduced environmental impact. Due to the high number of design variables and constraints, these challenges are typically…
Dmitri E. Kvasov, Yaroslav D. Sergeyev
In many important design problems, some decisions should be made by finding the global optimum of a multiextremal objective function subject to a set of constrains. Frequently, especially in engineering applications, the functions involved in optimization process are black-box with unknown analytical representations…
Nishant Gadde
Gaussian Process (GP) models have also become extremely useful for optimization under uncertainty algorithms, especially where the objective functions are costly to compute. Yet, the more classical methods usually adopt strategies that, in certain circumstances, might be effective but not flexible to be applied to a…
Doniyor Ulmasov, Caroline Baroukh, Benoît Chachuat, Marc Peter Deisenroth + 1 more
'Marc Peter Deisenroth' 'Ruth Misener'] Bayesian Optimization (BO) is a data-efficient method for global black-box optimization of an expensive-to-evaluate fitness function. BO typically assumes that computation cost of BO is cheap, but experiments are time consuming or costly. In practice, this allows us to optimize…
Rubén Martínez-Cantín
—The purpose of this paper is twofold. On one side, we present a general framework for Bayesian optimization and we compare it with some related fields in active learning and Bayesian numerical analysis. On the other hand, Bayesian optimization and related problems (bandits, sequential experimental design) are highly…