13 papers · ranked by Valyu relevance
Tadashi Wadayama, Kensho Nakajima, Ayano Nakai-Kasai
—The power consumption of the integrated circuit is becoming a significant burden, particularly for large-scale signal processing tasks requiring high throughput. The decoding process of LDPC codes is such a heavy signal processing task that demands power efficiency and higher decoding throughput. A promising approach…
Tadashi Wadayama, Lantian Wei
—This paper presents the Gradient Flow (GF) decoding for LDPC codes. GF decoding, a continuous-time methodology based on gradient flow, employs a potential energy function associated with bipolar codewords of LDPC codes. The decoding process of the GF decoding is concisely defined by an ordinary differential equation…
Tadashi Wadayama, Koji Igarashi, Takumi Takahashi
Differential Equations Authors: ['Tadashi Wadayama' 'Koji Igarashi' 'Takumi Takahashi'] Abstract—Digital communication systems inherently operate through physical media governed by partial differential equations (PDEs). In this paper, we introduce a physics-aware decoding framework that integrates gradient…
Muhammet Balcılar, Bharath Bhushan Damodaran, Karam Naser, Franck Galpin + 1 more
'Franck Galpin' 'Pierre Hellier'] End-to-end image/video codecs are getting competitive compared to traditional compression techniques that have been developed through decades of manual engineering efforts. These trainable codecs have many advantages over traditional techniques such as easy adaptation on perceptual…
Kyriakos Flouris, Anna Volokitin, Gustav Bredell, Ender Konukoğlu
The autoencoder model uses an encoder to map data samples to a lower dimensional latent space and then a decoder to map the latent space representations back to the data space. Implicitly, it relies on the encoder to approximate the inverse of the decoder network, so that samples can be mapped to and back from the…
Kyriakos Flouris, Anna Volokitin, Gustav Bredell, Ender Konukoğlu
The autoencoder model typically uses an encoder to map data to a lower dimensional latent space and a decoder to reconstruct it. However, relying on an encoder for inversion can lead to suboptimal representations, particularly limiting in physical sciences where precision is key. We introduce a decoder-only method…
Muhammet Balcılar, Bharath Bhushan Damodaran, Karam Naser, Franck Galpin + 1 more
'Franck Galpin' 'Pierre Hellier'] Abstract—End-to-end image and video codecs are becoming increasingly competitive, compared to traditional compression techniques that have been developed through decades of manual engineering efforts. These trainable codecs have many advantages over traditional techniques, such as…
Xuezhe Ma, Xiang Kong, Shanghang Zhang, Eduard Hovy
In this work, we propose a new generative model that is capable of automatically decoupling global and local representations of images in an entirely unsupervised setting, by embedding a generative flow in the VAE framework to model the decoder. Specifically, the proposed model utilizes the variational auto-encoding…
Shifeng Zhang, Ning Kang, Tom Ryder, Zhenguo Li
It was estimated that the world produced 59ZB (5.9 × 1013GB) of data in 2020, resulting in the enormous costs of both data storage and transmission. Fortunately, recent advances in deep generative models have spearheaded a new class of socalled "neural compression" algorithms, which significantly outperform traditional…
Jonathan Ho, Evan Lohn, Pieter Abbeel
Likelihood-based generative models are the backbones of lossless compression due to the guaranteed existence of codes with lengths close to negative log likelihood. However, there is no guaranteed existence of computationally efficient codes that achieve these lengths, and coding algorithms must be hand-tailored to…
Shifeng Zhang, Chen Zhang, Ning Kang, Zhenguo Li
It is nontrivial to store rapidly growing big data nowadays, which demands high-performance lossless compression techniques. Likelihood-based generative models have witnessed their success on lossless compression, where flow based models are desirable in allowing exact data likelihood optimisation with bijective…
Chin‐Wei Huang, Laurent Dinh, Aaron Courville
In this work, we propose a new family of generative flows on an augmented data space, with an aim to improve expressivity without drastically increasing the computational cost of sampling and evaluation of a lower bound on the likelihood. Theoretically, we prove the proposed flow can approximate a Hamiltonian ODE as a…
Diederik P. Kingma, Tim Salimans, Rafał Józefowicz, Xi Chen + 2 more
'Ilya Sutskever' 'Max Welling'] The framework of normalizing flows provides a general strategy for flexible variational inference of posteriors over latent variables. We propose a new type of normalizing flow, inverse autoregressive flow (IAF), that, in contrast to earlier published flows, scales well to…