16 papers · ranked by Valyu relevance
Joshua Bowren, Luis Gonzalo Sánchez-Giraldo, Odelia Schwartz
Sparse coding has been incorporated in models of the visual cortex for its computational advantages and connection to biology. But how the level of sparsity contributes to performance on visual tasks is not well understood. In this work, sparse coding has been integrated into an existing hierarchical V2 model (Hosoya…
Ilias Rentzeperis, Luca Calatroni, Laurent Perrinet, Dario Prandi
Growing evidence indicates that only a sparse subset from a pool of sensory neurons is active for the encoding of visual stimuli at any instant in time. Traditionally, to replicate such biological sparsity, generative models have been using the ℓ1 norm as a penalty due to its convexity, which makes it amenable to fast…
Geoffrey Kasenbacher, Felix Ehret, Gerrit A. Ecke, Sebastian Otte
Algorithm Authors: ['Geoffrey Kasenbacher' 'Felix Ehret' 'Gerrit A. Ecke' 'Sebastian Otte'] The locally competitive algorithm (LCA) can solve sparse coding problems across a wide range of use cases. Recently, convolution-based LCA approaches have been shown to be highly effective for enhancing robustness for image…
Geoffrey Kasenbacher, Daniel Ruepp, Gerrit A. Ecke
Sparse coding provides a principled framework for signal representation by expressing an input as a linear combination of only a small number of basis functions. The Locally Competitive Algorithm (LCA) is particularly attractive in the context of neuromorphic computing because its dynamics, leaky integration…
Gavin Parpart, Carlos González, Terrence C. Stewart, Edward Kim + 5 more
'Jocelyn Rego' 'Andrew O’Brien' 'Steven Nesbit' 'Garrett T. Kenyon' 'Yijing Watkins'] The Locally Competitive Algorithm (LCA) uses local competition between non-spiking leaky integrator neurons to infer sparse representations, allowing for potentially real-time execution on massively parallel neuromorphic architectures…
Chunming Jiang, Yilei Zhang
Sparse representation has attracted great attention because it can greatly save storage re- sources and find representative features of data in a low-dimensional space. As a result, it may be widely applied in engineering domains including feature extraction, compressed sensing, signal denoising, picture clustering…
Costa, Valérie, Fel, Thomas + 6 more
Sparse autoencoders (SAEs) have recently become central tools for interpretability, leveraging dictionary learning principles to extract sparse, interpretable features from neural representations whose underlying structure is typically unknown. This paper evaluates SAEs in a controlled setting using MNIST, which…
Hugo Ladret, Christian Casanova, Laurent Perrinet
Both biological and artificial neural networks inherently balance their performance with their operational cost, which balances their computational abilities. Typically, an efficient neuromorphic neural network is one that learns representations that reduce the redundancies and dimensionality of its input. This is for…
Thomas Fel, Matthew Kowal, Mozes Jacobs, Dron Hazra + 21 more
What is the geometry of a visual percept? The most widely used protocols for decomposing neural network representations into interpretable parts treat concepts as isolated directions, yet recent work shows that concepts are often realized as geometric structures in low dimensional regions of activation space. We turn…
Yi‐Hsiang Huang, Yeonju Go, J. Huang, Shuhang Li + 8 more
'T. Marshall' 'Joseph Osborn' 'C. Pinkenburg' 'Yihui Ren' 'E. Shulga' 'Shinjae Yoo' 'Byung-Jun Yoon'] High-energy large-scale particle colliders generate data at extraordinary rates, reaching up to one terabyte per second in nuclear physics and several petabytes per second in high-energy physics. Developing real-time…
Wilkie Olin-Ammentorp
It has been well-established that within conventional neural networks, many of the values produced at each layer are zero. In this work, I demonstrate that spiking neural networks can prevent the transmission of spikes representing values close to zero using local information. This can reduce the amount of energy…
Adrián F. Amil, Ismael T. Freire, Paul F. M. J. Verschure
The hippocampus has been associated with both spatial cognition and episodic memory formation, but integrating these functions into a unified framework remains challenging. Here, we demonstrate that forming discrete memories of visual events in sparse autoencoder neurons can produce spatial tuning similar to…
Xuexing Du, Zhong-qi K. Tian, Songting Li, Douglas Zhou
Optimization Problems Authors: ['Xuexing Du' 'Zhong-qi K. Tian' 'Songting Li' 'Douglas Zhou'] We introduce a generalized Spiking Locally Competitive Algorithm (LCA) that is biologically plausible and exhibits adaptability to a large variety of neuron models and network connectivity structures. In addition, we provide…
Lingyun Ke, M. Hu
Encoding static images into spike trains is a crucial step for enabling Spiking Neural Networks (SNNs) to process visual information efficiently. However, existing schemes such as rate coding, Poisson encoding, and time-to-first-spike (TTFS) often ignore spatial relationships and yield temporally inconsistent spike…
Sizhen Bian, Elisa Donati, Michele Magno
Neural Network Authors: ['Sizhen Bian' 'Elisa Donati' 'Michele Magno'] Abstract—Spiking neural networks (SNNs), a brain-inspired computing paradigm, are emerging for their inference performance, particularly in terms of energy efficiency and latency attributed to the plasticity in signal processing. To deploy SNNs in…
Ahmad El Ferdaoussi, Éric Plourde, Jean Rouat
—The problem of spike encoding of sound consists in transforming a sound waveform into spikes. It is of interest in many domains, including the development of audio-based spiking neural networks, where it is the first and most crucial stage of processing. Many algorithms have been proposed to perform spike encoding of…