3 papers · ranked by Valyu relevance
Fabio Cumbo, Kabir Dhillon, M. Hassan Najafi, Sercan Aygun + 1 more
The exponential growth of genomic databases necessitates alignment-free methods for comparing genomes. While MinHash-based tools have revolutionized this field by efficiently estimating the Average Nucleotide Identity based on k-mer sets, they inherently discard structural genomic information. We introduce HyperSketch…
Hao Ding, Nannan Wu, Tianyi Qiu
DNA foundation models such as Evo2 7B adopt hybrid Hyena/attention architectures (Striped-Hyena2) whose single-stream autoregressive decoding is bounded by weight bandwidth at ∼45 tok/s. Speculative decoding on such hybrids faces a systems problem that prior SSM work solves only partially: after a draft is verified…
Eliezer Masliah
How transient neural representations become integrated and stable enough to function as internal neural models remains incompletely understood. Grounded in efficient coding, Bayesian and predictive frameworks, recurrent and attractor dynamics, neural state-space models, and systems neuroscience, the Principle of…