16 papers · ranked by Valyu relevance
Lennard J. Kwakernaak, Martin van Hecke
Materials with an irreversible response to cyclic driving exhibit an evolving internal state which, in principle, encodes information on the driving history. Here we realize irreversible metamaterials that count mechanical driving cycles and store the result into easily interpretable internal states. We extend these…
Kevin Zhang, Neha Patki, Kalyan Veeramachaneni
The goal of this paper is to describe a system for generating synthetic sequential data within the Synthetic data vault. To achieve this, we present the Sequential model currently in SDV, an end-to-end framework that builds a generative model for multi-sequence, real-world data. This includes a novel neural…
Daniel Waxman, Fernando Llorente, Petar M. Djurić
The proliferation of capable and efficient machine learning (ML) models marks one of the strongest methodological shifts in signal processing (SP) in its nearly 100-year history. ML models support the development of SP systems that represent complex, nonlinear relationships with high predictive accuracy. Adapting these…
Bing Han, Cheng Wang, Kaushik Roy
Tremendous progress has been made in sequential processing with the recent advances in recurrent neural networks. However, recurrent architectures face the challenge of exploding/vanishing gradients during training, and require significant computational resources to execute back-propagation through time. Moreover…
Vida Ranjbar, Robbert Beerten, Marc Moonen, Sofie Pollin
—Cell-free massive multiple-input multiple-output (MIMO) is an emerging technology that will reshape the architecture of next-generation networks. This paper considers the sequential fronthaul, whereby the access points (APs) are connected in a daisy chain topology with multiple sequential processing stages. With this…
Jon Sporring, David Stansby
This report addresses larger-than-memory image analysis for petascale datasets such as 1.4 PB electron-microscopy volumes [[4]] and 150 TB human-organ atlases [[6]]. We argue that performance is fundamentally I/O-bound rather than compute-bound. We show that structuring analysis as streaming passes over data is…
Richard Futrell, Michael Hahn
Processing Authors: ['Richard Futrell' 'Michael Hahn'] Human language is a unique form of communication in the natural world, distinguished by its structured nature. Most fundamentally, it is systematic, meaning that signals can be broken down into component parts that are individually meaningful—roughly, words—which…
Giulio Basso, Reinhold Scherer, Michael Taynnan Barros
Storage for Neurons-on-a-chip Authors: ['Giulio Basso' 'Reinhold Scherer' 'Michael Taynnan Barros'] With conventional silicon-based computing approaching its physical and efficiency limits, biocomputing emerges as a promising alternative. This approach utilises biomaterials such as DNA and neurons as an interesting…
Yingru Li
We introduce the first probabilistic framework tailored for sequential random projection, an approach rooted in the challenges of sequential decision-making under uncertainty. The analysis is complicated by the sequential dependence and highdimensional nature of random variables, a byproduct of the adaptive mechanisms…
Franz A. Heinsen
We find a succinct expression for computing the sequence xt = atxt−1 + bt in parallel with two prefix sums, given t = (1, 2, . . . , n), at ∈ R n , bt ∈ R n , and initial value x0 ∈ R. On n parallel processors, the computation of n elements incurs O(log n) time and O(n) space. Sequences of this form are ubiquitous in…
Ao Sun, Weilin Zhao, Xu Han, Cheng Yang + 3 more
Language Model Training Authors: ['Ao Sun' 'Weilin Zhao' 'Xu Han' 'Cheng Yang' 'Zhiyuan Liu' 'Chuan Shi' 'Maosong Sun'] The emergence of large language models (LLMs) relies heavily on distributed training strategies, among which pipeline parallelism plays a crucial role. As LLMs' training sequence length extends to 32k…
Hanwen Du, Huanhuan Yuan, Zhen Huang, Pengpeng Zhao + 1 more
Generative models, such as Variational Auto-Encoder (VAE) and Generative Adversarial Network (GAN), have been successfully applied in sequential recommendation. These methods require sampling from probability distributions and adopt auxiliary loss functions to optimize the model, which can capture the uncertainty of…
Amir H. Dadpour, Timur Khayrullin, Fouad Afiouni, Remy El Sabeh + 3 more
'Amer E. Mouawad' 'Izzat El Hajj' 'Alexandre Cooper'] We present and characterize a modular, open-source system to perform feedback control experiments on configurations of atoms and molecules in arrays of optical tweezers. The system features a modular, cost-effective computer architecture with a motherboard and…
Ruicheng Ao, Gan Luo, David Simchi-Levi, Xinshang Wang
Large Language Models (LLMs) is indispensable in today's applications, but their inference procedure—generating responses by breaking text into smaller pieces and processing them using a memoryheavy element named Key-Value (KV) cache—requires a lot of computational resources, especially when memory is limited. This…
Tairan Xu, Leyang Xue, Zhan Lu, Jinfu Deng + 6 more
Batch inference has become a central mode of AI computation, yet existing inference engines still rely on execution models designed for interactive serving. When scaled to millions of sequences, batch workloads reveal two fundamental requirements: the ability to handle extreme inter- and intra-sequence load variation…
Marios Fragkoulis, Paris Carbone, Vasiliki Kalavri, Asterios Katsifodimos
'Asterios Katsifodimos'] Abstract Stream processing has been an active research field for more than 20 years, but it is now witnessing its prime time due to recent successful efforts by the research community and numerous worldwide open-source communities. This survey provides a comprehensive overview of fundamental…