7 papers · ranked by Valyu relevance
Hao Ding, Nannan Wu, Tianyi Qiu
DNA foundation models such as Evo2 7B adopt hybrid Hyena/attention architectures (Striped-Hyena2) whose single-stream autoregressive decoding is bounded by weight bandwidth at ∼45 tok/s. Speculative decoding on such hybrids faces a systems problem that prior SSM work solves only partially: after a draft is verified…
Eun Joo Kim, Ji Hoon Jeong, June-Seek Choi, Jeansok J. Kim
A fundamental challenge for animals and humans is resolving competing survival demands under naturalistic threat, yet circuit-level mechanisms remain poorly understood. We developed a paradigm recapitulating a predator-prey encounter: Long-Evans rats emerged from a nest to forage in an open arena, choosing between…
Alp Tartici, Mihajlo Stojkovic, Anru Tian, Michael C. Jewett + 2 more
Protein engineering has important implications in the bioeconomy, enabling applications in materials, medicine, and energy. A key challenge is designing protein sequences that have a specific form and function. Protein inverse folding seeks to address this challenge by identifying amino acid sequences compatible with a…
Fabio Cumbo, Kabir Dhillon, M. Hassan Najafi, Sercan Aygun + 1 more
The exponential growth of genomic databases necessitates alignment-free methods for comparing genomes. While MinHash-based tools have revolutionized this field by efficiently estimating the Average Nucleotide Identity based on k-mer sets, they inherently discard structural genomic information. We introduce HyperSketch…
ChenTianyi Yang, Andrew Thwaites, Cai Wingfield, Chao Zhang + 1 more
The brain builds meaning from speech in stages, transforming acoustic input into linguistic comprehension. Yet where comprehension separates from general acoustic processing has been difficult to localize, because the two are tightly entangled in continuous speech. Here we align the activity of 145,000 individual…
Yi Ren, Zimei Chen, Hayden Deans, Ying Nian Wu + 1 more
Extensive studies suggest the brain performs Bayesian inference to infer the latent world states. It is a fundamental neuroscience question that how canonical recurrent neural circuits in the brain implement Bayesian inference. Many existing theoretical studies focused on how the recurrent circuits compute the…
Eliezer Masliah
How transient neural representations become integrated and stable enough to function as internal neural models remains incompletely understood. Grounded in efficient coding, Bayesian and predictive frameworks, recurrent and attractor dynamics, neural state-space models, and systems neuroscience, the Principle of…