13 papers · ranked by Valyu relevance
Vincent Roulet, Mathieu Blondel
Gauss-Newton (a.k.a. prox-linear) directions can be computed by solving an optimization subproblem that trade-offs between a partial linearization of the objective function and a proximity term. In this paper, we study for the first time the possibility to leverage the convexity of this subproblem in order to instead…
Felipe Atenas, Minh N. Dao, Matthew K. Tam
Lipschitz data Authors: ['Felipe Atenas' 'Minh N. Dao' 'Matthew K. Tam'] In this paper, we propose a distributed first-order algorithm with backtracking linesearch for solving multi-agent minimisation problems, where each agent handles a local objective involving nonsmooth and smooth components. Unlike existing methods…
Haoyu Jiang, Jason Xu
Stochastic versions of proximal methods have gained much attention in statistics and machine learning. These algorithms tend to admit simple, scalable forms, and enjoy numerical stability via implicit updates. In this work, we propose and analyze a stochastic version of the recently proposed proximal distance…
Adeyemi D. Adeoye, Alberto Bemporad
We introduce a notion of self-concordant smoothing for minimizing the sum of two convex functions, one of which is smooth and the other may be nonsmooth. The key highlight of our approach is in a natural property of the resulting problem's structure which provides us with a variable-metric selection method and a…
Lahcen El Bourkhissi, Ion Necoara
In this paper, we consider a nonconvex optimization problem with nonlinear equality constraints. We assume that both, the objective function and the functional constraints are locally smooth. For solving this problem, we propose a linearized augmented Lagrangian method, i.e., we linearize the functional constraints in…
Kathryn Linehan, Radu Bălan
Neural Network Authors: ['Kathryn Linehan' 'Radu Bălan'] Computing the proximal operator of the ℓ∞ norm, proxα||·||∞(x), generally requires a sort of the input data, or at least a partial sort similar to quicksort. In order to avoid using a sort, we present an O(m) approximation of proxα||·||∞(x) using a neural…
Muhammad Adil, Ramtin Madani, Sasan Tavakkol, Ali Davoudi
—This paper offers a matrix-free first-order numerical method to solve large-scale conic optimization problems. Solving systems of linear equations pose the most computationally challenging part in both first-order and second-order numerical algorithms. Existing direct and indirect methods are either computationally…
Jing He, Qi-wei Kong, Ho-Chung Lui, Haitao Liu + 1 more
The definition of factor space and a unified optimization based classification model were developed for linear programming and supervised learning. Intelligent behaviour appeared in a decision process can be treated as a moving point y, the dynamic state observed and controlled by the agent, moving in a factor space…
Loïc Van Hoorebeeck, P. -A. Absil, Anthony Papavasiliou
We address the problem of projecting a point onto a quadratic hypersurface, more specifically a central quadric. We show how this problem reduces to finding a given root of a scalar-valued nonlinear function. We completely characterize one of the optimal solutions of the projection as either the unique root of this…
Yang, Yaguang
This paper presents a Matlab implementation of an arc-search infeasible interior point algorithm for linear programming (LP), which has a proven polynomial bound of $\mathcal{O}(\sqrt{n}L)$, the best among all interior-point algorithms for LP. Software architecture and major functions are discussed. Its ease of use is…
Yong-Jin Liu, Weimi Zhou
Solving the distributional worst-case in the distributionally robust optimization problem is equivalent to finding the projection onto the intersection of simplex and singly linear inequality constraint, which is an important ingredient in the design of some first-order efficient algorithms. This paper focuses on…
Jake Roth, Ying Cui
Implicit Scenario Reduction Authors: ['Jake Roth' 'Ying Cui'] Superquantiles have recently gained significant interest as a risk-aware metric for addressing fairness and distribution shifts in statistical learning and decision making problems. This paper introduces a fast, scalable and robust second-order computational…
Chao Ding, Fuxiaoyue Feng, Xudong Li
In this paper, we study dual semismooth Newton (SSN) methods for degenerate polyhedral projection problems, where generalized Jacobians of the dual residual may remain singular even arbitrarily close to the solution set. Rather than regularizing these singular systems, we exploit the nonuniqueness of the dual…