15 papers · ranked by Valyu relevance
Wei, Yuan-Hao, Yan-Jie Sun
This study advances the Variational Autoencoder (VAE) framework by addressing challenges in Independent Component Analysis (ICA) under both determined and underdetermined conditions, focusing on enhancing the independence and interpretability of latent variables. Traditional VAEs map observed data to latent variables…
Ehsan Abbasnejad, Anthony Dick, Anton van den Hengel
This paper presents an infinite variational autoencoder (VAE) whose capacity adapts to suit the input data. This is achieved using a mixture model where the mixing coefficients are modeled by a Dirichlet process, allowing us to integrate over the coefficients when performing inference. Critically, this then allows us…
Andrea Asperti
In this article, we highlight what appears to be major issue of Variational Autoencoders (VAEs), evinced from an extensive experimentation with different networks architectures and datasets: the variance of generated data is significantly lower than that of training data. Since generative models are usually evaluated…
Gautam Ramachandra
In recent years Variation Autoencoders have become one of the most popular unsupervised learning of complicated distributions. Variational Autoencoder (VAE) provides more efficient reconstructive performance over a traditional autoencoder. Variational auto enocders make better approximaiton than MCMC. The VAE defines a…
Gananath R
Variational Autoencoders (VAEs) belong to a family of autoencoders with probabilistic properties, making them well suited for generating data by producing a smooth and continuous latent space. Despite being introduced over a decade ago, the method continues to be widely adopted in both research and industry for diverse…
Alan Jeffares, Liyuan Liu
Variational Autoencoders (VAEs) are well-established as a principled approach to probabilistic unsupervised learning with neural networks. Typically, an encoder network defines the parameters of a Gaussian distributed latent space from which we can sample and pass realizations to a decoder network. This model is…
Ali Taylan Cemgil, Sumedh Ghaisas, Krishnamurthy Dvijotham, Sven Gowal + 1 more
'Sven Gowal' 'Pushmeet Kohli'] Does a Variational AutoEncoder (VAE) consistently encode typical samples generated from its decoder? This paper shows that the perhaps surprising answer to this question is 'No'; a (nominally trained) VAE does not necessarily amortize inference for typical samples that it is capable of…
Mariano Rivera
Variational Autoencoders (VAEs) have become a cornerstone in generative modeling and representation learning within machine learning. This paper explores a nuanced aspect of VAEs, focusing on interpreting the Kullback–Leibler (KL) Divergence, a critical component within the Evidence Lower Bound (ELBO) that governs the…
R. I. Cukier
Variational autoencoders (VAEs) are one class of generative probabilistic latent‐variable models designed for inference based on known data. We develop three variations on VAEs by introducing a second parameterized encoder/decoder pair and, for one variation, an additional fixed encoder. The parameters of the…
Andrea Asperti, Laura Bugo, Daniele Filippini
In this article we introduce the notion of Split Variational Autoencoder (SVAE), whose output xˆ is obtained as a weighted sum σ xˆ1 + (1 − σ) xˆ2 of two generated images xˆ1, xˆ2, and σ is a learned compositional map. The composing images xˆ1, xˆ2, as well as the σ-map are automatically synthesized by the model. The…
Xianxu Hou, Ke Sun, Linlin Shen, Guoping Qiu
We present a new method for improving the performances of variational autoencoder (VAE). In addition to enforcing the deep feature consistent principle thus ensuring the VAE output and its corresponding input images to have similar deep features, we also implement a generative adversarial training mechanism to force…
Mohamed Debbagh
Structured output representation is a generative task explored in computer vision that often times requires the mapping of low dimensional features to high dimensional structured outputs. Losses in complex spatial information in deterministic approaches such as Convolutional Neural Networks (CNN) lead to uncertainties…
Zachary G. Baker, Yuxiao Li
Sparse Autoencoders (SAEs) have emerged as a promising approach for interpreting neural network representations by learning sparse, human-interpretable features from dense activations. We investigate whether incorporating variational methods into SAE architectures can improve feature organization and interpretability.…
Yiran Dong, Chuanhou Gao
variational autoencoder Authors: ['Yiran Dong' 'Chuanhou Gao'] Abstract—In this paper, we develop the notion of evidence lower bound difference (ELBD), based on which an efficient score algorithm is presented to implement feature selection on latent variables of VAE and its variants. Further, we propose weak…
Gianluigi Silvestri, Daan Roos, Luca Ambrogioni
In this work, we provide a deterministic alternative to the stochastic variational training of generative autoencoders. We refer to these new generative autoencoders as AutoEncoders within Flows (AEF), since the encoder and decoder are defined as affine layers of an overall invertible architecture. This results in a…