Search · four archives
Search · four archives
13 papers · ranked by Valyu relevance
Anindya De, Ilias Diakonikolas, Rocco A. Servedio
to within an additive ±ǫ in time poly(n, 2 poly(1/ǫ) ). Note that it is NP-hard to determine whether the above probability is nonzero, so any sort of multiplicative approximation is almost certainly impossible even for efficient randomized algorithms. This is the first deterministic algorithm for this counting problem…
Bennet Gebken
Approximation of subdifferentials is one of the main tasks when computing descent directions for nonsmooth optimization problems. In this article, we propose a bisection method for weakly lower semismooth functions which is able to compute new subgradients that improve a given approximation in case a direction with…
In‐Su Han, Prabhanjan Kambadur, Kyoungsoo Park, Jinwoo Shin
Determinantal point processes (DPPs) are popular probabilistic models that arise in many machine learning tasks, where distributions of diverse sets are characterized by matrix determinants. In this paper, we develop fast algorithms to find the most likely configuration (MAP) of large-scale DPPs, which is NP-hard in…
Marie Billaud-Friess, Arthur Macherey, Anthony Nouy, Clémentine Prieur
'Clémentine Prieur'] Probabilistic variants of Model Order Reduction (MOR) methods have recently emerged for improving stability and computational performance of classical approaches. In this paper, we propose a probabilistic Reduced Basis Method (RBM) for the approximation of a family of parameterdependent functions.…
Lindon Roberts, Clément W. Royer
Derivative-free algorithms seek the minimum value of a given objective function without using any derivative information. The performance of these methods often worsen as the dimension increases, a phenomenon predicted by their worst-case complexity guarantees. Nevertheless, recent algorithmic proposals have shown that…
Daniel Dadush, Akshay Ramachandran
The frame scaling problem is: given vectors U := {u1, ..., un} ⊆ R d , marginals c ∈ R n ++, and precision ε > 0, find left and right scalings L ∈ R d×d , r ∈ R n such that (v1, . . . , vn) := (Lu1r1, . . . , Lunrn) simultaneously satisfies Pn i=1 viv T i = Id and kvjk 2 2 = cj , ∀j ∈ [n], up to error ε. This problem…
K. J. Dzahini, Stefan M. Wild
zeroth-, first-, and second-order convergence and expected complexity Authors: ['K. J. Dzahini' 'Stefan M. Wild'] Abstract: Stochastic directional direct-search (SDDS) algorithms were recently introduced as an extension to stochastically noisy objectives of a broad class of algorithms including the well-known mesh…
Attila Nagy, Goitom Simret Kidane, Tamás Turányi, János Tóth
A novel stochastic optimization method called MAC was suggested. The method is based on the calculation of the objective function at several random points and then an empirical expected value and an empirical covariance matrix are calculated. The empirical expected value is proven to converge to the optimum value of…
Panos Toulis, Thibaut Horel, Edoardo M. Airoldi
The need for parameter estimation with massive data has reinvigorated interest in iterative estimation procedures. Stochastic approximations, such as stochastic gradient descent, are at the forefront of this recent development because they yield simple, generic, and extremely fast iterative estimation procedures. Such…
Stéphane Alarie, Charles Audet, Pierre-Yves Bouchet, Sébastien Le Digabel
'Sébastien Le Digabel'] In derivative-free and blackbox optimization, the objective function is often evaluated through the execution of a computer program seen as a blackbox. It can be noisy, in the sense that its outputs are contaminated by random errors. Sometimes, the source of these errors is identified and…
Andrea Montanari, Eliran Subag
We consider the problem of efficiently solving a system of n non-linear equations in R d . Addressing Smale's 17th problem stated in 1998, we consider a setting whereby the n equations are random homogeneous polynomials of arbitrary degrees. In the complex case and for n = d−1, Beltrán and Pardo proved the existence of…
Shmuel Friedland, Venu Tammali
In many applications such as data compression, imaging or genomic data analysis, it is important to approximate a given tensor by a tensor that is sparsely representable. For matrices, i.e. 2-tensors, such a representation can be obtained via the singular value decomposition, which allows to compute best rank…
Xiaopeng Luo, Xin Xu
We propose and analyze asymptotic proximal point (APP) methods to find the global minimizer for a class of nonconvex, nonsmooth, or even discontinuous multiple minima functions. The method is based on an asymptotic representation of nonconvex proximal points so that it can find the global minimizer without being…