11 papers · ranked by Valyu relevance
Yuxin Jiang, Wenqin Zhang, Lele Wang
Gradient coding is a distributed computing technique aiming to provide robustness against slow or non-responsive computing nodes, known as stragglers, while balancing the computational load for responsive computing nodes. Among existing gradient codes, a construction based on combinatorial designs, called BIBD gradient…
Sinong Wang, Jiashang Liu, Ness B. Shroff
It has been established that when the gradient coding problem is distributed among n servers, the computation load (number of stored data partitions) of each worker is at least s + 1 in order to resists s stragglers [1]. This scheme incurs a large overhead when the number of stragglers s is large. In this paper, we…
Ari S. Benjamin, Ling-Qi Zhang, Cheng Qiu, Alan Stocker + 1 more
Animal sensory systems are more sensitive to common features in the environment than uncommon features. For example, small deviations from the more frequently encountered horizontal orientations can be more easily detected than small deviations from the less frequent diagonal ones. Here we find that artificial neural…
Muhammet Balcılar, Bharath Bhushan Damodaran, Karam Naser, Franck Galpin + 1 more
'Franck Galpin' 'Pierre Hellier'] End-to-end image/video codecs are getting competitive compared to traditional compression techniques that have been developed through decades of manual engineering efforts. These trainable codecs have many advantages over traditional techniques such as easy adaptation on perceptual…
Tadashi Wadayama, Lantian Wei
—This paper presents the Gradient Flow (GF) decoding for LDPC codes. GF decoding, a continuous-time methodology based on gradient flow, employs a potential energy function associated with bipolar codewords of LDPC codes. The decoding process of the GF decoding is concisely defined by an ordinary differential equation…
Julio A. Peraza, Taylor Salo, Michael C. Riedel, Katherine L. Bottenhorn + 14 more
Macroscale gradients have emerged as a central principle for understanding functional brain organization. Previous studies have demonstrated that a principal gradient of connectivity in the human brain exists, with unimodal primary sensorimotor regions situated at one end, and transmodal regions associated with the…
Reinder Vos de Wael, Oualid Benkarim, Casey Paquola, Sara Lariviere + 10 more
Understanding how higher order cognitive function emerges from the underlying brain structure depends on quantifying how the behaviour of discrete regions are integrated within the broader cortical landscape. Recent work has established that this macroscale brain organization and function can be quantified in a compact…
Tony Shaska
We introduce the Graded Transformer framework, embedding algebraic inductive biases via grading transformations on vector spaces. Extending Graded Neural Networks (GNNs), we propose the Linearly Graded Transformer (LGT) and Exponentially Graded Transformer (EGT), which apply parameterized scaling—via fixed or learnable…
Leonard Schmiester, Daniel Weindl, Jan Hasenauer
Unknown parameters of dynamical models are commonly estimated from experimental data. However, while various efficient optimization and uncertainty analysis methods have been proposed for quantitative data, methods for qualitative data are rare and suffer from bad scaling and convergence. Here, we propose an efficient…
Il Memming Park, Jonathan W. Pillow
The efficient coding hypothesis, which proposes that neurons are optimized to maximize information about the environment, has provided a guiding theoretical framework for sensory and systems neuroscience. More recently, a theory known as the Bayesian Brain hypothesis has focused on the brain’s ability to integrate…
Hyunmin Cho, Jaejun Yoo, Kyong Hwan Jin
We study sinusoidal recurrence as an iterative mechanism for harmonic spectral enrichment in implicit neural representations (INRs). Our analysis reveals that sinusoidal activations induce a harmonic line spectrum, providing a spectral account of how recurrent unrolling enriches the effective spectral support. We…