14 papers · ranked by Valyu relevance
Raian Noufel Lefgoum
In this paper we study a new approach in optimization that aims to search a large domain D where a given function takes large, small or specific values via an iterative optimization algorithm based on the gradient. We show that the objective function used is not directly optimizable, however, we use a trick to…
Yang Yang, Marius Pesavento
—In this paper, we propose a successive pseudo-convex approximation algorithm to efficiently compute stationary points for a large class of possibly nonconvex optimization problems. The stationary points are obtained by solving a sequence of successively refined approximate problems, each of which is much easier to…
Demelas, Francesca, Roux, Joseph Le + 8 more
This paper presents Bundle Network, a learning-based algorithm inspired by the Bundle Method for convex non-smooth minimization problems. Unlike classical approaches that rely on heuristic tuning of a regularization parameter, our method automatically learns to adjust it from data. Furthermore, we replace the iterative…
Yao Shu, Jiongfeng Fang, Ying Tiffany He, F. Richard Yu
Parallelized Iterations Authors: ['Yao Shu' 'Jiongfeng Fang' 'Ying Tiffany He' 'F. Richard Yu'] First-order optimization (FOO) algorithms are pivotal in numerous computational domains such as machine learning and signal denoising. However, their application to complex tasks like neural network training often entails…
Feiping Nie, Zhanxuan Hu, Xiaoqian Wang, Rong Wang + 2 more
'Heng Huang'] Abstract—This work aims at solving the problems with intractable sparsity-inducing norms that are often encountered in various machine learning tasks, such as multi-task learning, subspace clustering, feature selection, robust principal component analysis, and so on. Specifically, an Iteratively…
Ruichen Jiang, Ali Kavis, Qiujiang Jin, Sujay Sanghavi + 1 more
Optimization Authors: ['Ruichen Jiang' 'Ali Kavis' 'Qiujiang Jin' 'Sujay Sanghavi' 'Aryan Mokhtari'] We propose adaptive, line search-free second-order methods with optimal rate of convergence for solving convex-concave min-max problems. By means of an adaptive step size, our algorithms feature a simple update rule…
Jason Rader, Terry Lyons, Patrick Kidger
We introduce Optimistix: a nonlinear optimisation library built in JAX and Equinox. Optimistix introduces a novel, modular approach for its minimisers and least-squares solvers. This modularity relies on new practical abstractions for optimisation which we call search and descent, and which generalise classical notions…
Nikita Belokonev, Artem Melnikov, Maninadh Podapaka, Karan Pinto + 2 more
'Markus Pflitsch' 'Michael Perelshtein'] Chemical component design is a computationally challenging procedure that often entails iterative numerical modeling and authentic experimental testing. We demonstrate a novel optimization method, Tensor train Optimization (TetraOpt), for the shape optimization of components…
Alexander Mitsos, Jaromił Najman, Ioannis G. Kevrekidis
AVT Process Systems Engineering (SVT), RWTH Aachen University, Turmstrasse 46, Aachen, 52064, Germany, amitsos@alum.mit.edu ORCID: 0000-0003-0335-6566 Ioannis G. Kevrekidis (corresponding, yannis@princeton.edu) Department of Chemical and Biological Engineering & Program in Applied and Computational Mathematics…
Ashish Anil Pawar, Ujwal Warbhe
Bayesian Optimization is an effective method for searching the global maxima of an objective function especially if the function is unknown. The process comprises of using a surrogate function and choosing an acquisition function followed by optimizing the acquisition function to find the next sampling point. This…
Rubén Martínez-Cantín
—The purpose of this paper is twofold. On one side, we present a general framework for Bayesian optimization and we compare it with some related fields in active learning and Bayesian numerical analysis. On the other hand, Bayesian optimization and related problems (bandits, sequential experimental design) are highly…
Hugo Silva, Martha White
Network? Authors: ['Hugo Silva' 'Martha White'] Oftentimes, machine learning applications using neural networks involve solving discrete optimization problems, such as in pruning, parameter-isolation-based continual learning and training of binary networks. Still, these discrete problems are combinatorial in nature and…
Philipp‐Immanuel Schneider, Martin Hammerschmidt, Lin Zschiedrich, Sven Burger
'Sven Burger'] Optical scatterometry is a method to measure the size and shape of periodic micro- or nanostructures on surfaces. For this purpose the geometry parameters of the structures are obtained by reproducing experimental measurement results through numerical simulations. We compare the performance of Bayesian…
Stephen Jay Gould, Basura Fernando, Anoop Cherian, Peter Anderson + 2 more
'Rodrigo Santa Cruz' 'Edison Guo'] Some recent works in machine learning and computer vision involve the solution of a bilevel optimization problem. Here the solution of a parameterized lower-level problem binds variables that appear in the objective of an upper-level problem. The lower-level problem typically appears…