Search · four archives
Search · four archives
13 papers · ranked by Valyu relevance
de Colnet, Alexis, Meel, Kuldeep S. + 2 more
In this work, we study the fundamental problems of counting and sampling traces that a regular language touches. Formally, one fixes the alphabet Σ and an independence relation I ⊆ Σ × Σ. The computational problems we address take as input a regular language over Σ, presented as a finite automaton with states, together…
Georgy Noarov, Aaron Roth
A model is multicalibrated on a collection of group weights $G$ if it is calibrated -- i.e. unbiased even conditional on its prediction -- not just overall, but also after reweighting contexts by each $g \in G$. It is a useful property for many downstream applications and is a basic desideratum of trustworthy machine…
Xiong, Shifeng
In this note we introduce a simple numerical sampling method, called candidate set sampling, which is based on an straightforward discretization to the density function. This method requires the knowledge of the density function (up to an unknown normalizing constant) only. Furthermore, candidate set sampling is…
Marco Radaelli, Claudia Benedetti, Stefano Olivares
We investigate the use of discrete-time quantum walks to sample from an almost-uniform distribution, in the absence of any external source of randomness. Integers are encoded on the vertices of a cycle graph, and a quantum walker evolves for a fixed number of steps before its position is measured and recorded. The…
Yunsoo Ha, Sara Shashaani, Quoc Tran-dinh
We propose a stochastic nonconvex optimization algorithm that achieves almost sure $\tilde{\mathcal{O}}(ε^{-1.5})$ iteration complexity for problems with smooth objective functions and gradients only observable with noise. The mean-zero stochastic noise is decision-dependent and has unbounded support with…
Jiale Linghu, Yangshuai Wang
Random feature collocation fixes a randomly generated trial space and determines its coefficients from a linear least-squares system. Stability then depends on whether the sampled residual equations represent the geometry induced by the differential operator. We construct an operator-aware discretization in which the…
David G. Harris, Vladimir Kolmogorov, Hongyang Liu, Yitong Yin + 1 more
The computational equivalence between approximate counting and sampling is well established for polynomial-time algorithms. The most efficient general reduction from counting to sampling is achieved via simulated annealing, where the counting problem is formulated in terms of estimating the ratio…
Nima Anari, Carlo Baronio, C. M. Chen, Alireza Haqi + 3 more
We present parallel algorithms to accelerate sampling via counting in two settings: any-order autoregressive models and denoising diffusion models. An any-order autoregressive model accesses a target distribution on [] through an oracle that provides conditional marginals, while a denoising diffusion model accesses a…
Arnaud Carayol, Pablo Rotondo
In this article, we develop efficient sampling algorithms for random surjections from $[n]$ to $[k]$ for all $n \geq k$. We make no assumption about $n$ and $k$. In particular, we do not make the common assumption that the ratio $\frac{n}{k}$ is constant. All our guarantees are uniform in $n$ and $k$. Our first insight…
Michael R. Metel
Motivated by an application in machine learning optimization, this paper focuses on the challenges of sampling a matrix uniformly from the unit spectral norm ball. It is proven that all singular values of sampled matrices converge to 1 almost surely as the matrix dimensions increase. This result provides the…
Patrik Guggenberger, Nihal Mehta, Nikita Pavlov
Consider a setup in which a decision maker is informed about the population by a finite sample and based on that sample has to decide whether or not to apply a certain treatment. We work out finite sample minimax regret treatment rules under various sampling schemes when outcomes are restricted onto the unit interval.…
Christel Baier, Sascha Klüppelholz, Timm Spork
Families of deterministic finite automata (FDFA) have been introduced as a concise automaton model that characterizes $ω$-regular languages by processing their ultimately periodic words. FDFA are known to enjoy many good properties and can be exponentially more succinct than deterministic $ω$-automata with Rabin…
Miha Brešar, Aleksandar Mijatović
We introduce a new class of uniformly ergodic MCMC algorithms, termed Diffeomorphic Contraction Sampler (DCS), and provide fast non-asymptotic mixing guarantees for DCS targeting distributions on $\R^d$ with arbitrarily heavy polynomial tails. DCS provides a solution to a well-known problem for MCMC samplers, which…