9 papers · ranked by Valyu relevance
Seonghwan Seo, Hyeongwoo Kim, Seokhyun Moon, Woo Youn Kim
Protein language models (PLMs) trained on evolutionary sequences learn representations that encode protein structure, enabling direct structure prediction without multiple-sequence alignments (MSAs). Here we present the Atlas model family, an open and trainable system spanning protein language modeling, monomer…
Eliezer Masliah
How transient neural representations become integrated and stable enough to function as internal neural models remains incompletely understood. Grounded in efficient coding, Bayesian and predictive frameworks, recurrent and attractor dynamics, neural state-space models, and systems neuroscience, the Principle of…
Hao Ding, Nannan Wu, Tianyi Qiu
DNA foundation models such as Evo2 7B adopt hybrid Hyena/attention architectures (Striped-Hyena2) whose single-stream autoregressive decoding is bounded by weight bandwidth at ∼45 tok/s. Speculative decoding on such hybrids faces a systems problem that prior SSM work solves only partially: after a draft is verified…
Henrique Reis Aguiar, Matthias H. Hennig
Predictive coding is a powerful normative framework for understanding cortical computation, but it is still an open question how biologically plausible networks with local plasticity support predictive inference and representation learning. In this work we show that a recurrent excitatory-inhibitory circuit with purely…
Lou Thomas, Gaia Scerif, Hodo Yusuf, Mackenzie Laird + 3 more
Diffusion decision models (DDMs) offer the potential to go beyond standard accuracy and response-time indices to better understand perceptual decision-making in autism. One unanswered question is whether autistic participants can flexibly adjust the speed and accuracy of their decision-making according to task demands.…
Kunyu Wang, Jon Paul Janet, Alessandro Tibo
Three-dimensional molecular generative models have emerged that produce de novo molecules both unconditionally and conditionally, e.g., within protein pockets. However, steering those models in a specific region of the chemical space that satisfies a set of desired properties remains challenging. In this study, we…
Hayato Idei, Keisuke Suzuki, Yuichi Yamashita
Mindfulness has established psychological benefits, such as stress reduction and emotional regulation; however, the underlying computational mechanisms, particularly in relation to mind-wandering, remain unclear. This study aimed to present a hierarchical recurrent neural network-based agent model grounded in the free…
Ivan Specht, Soyoon Park, Seyone Chithrananda, Claudia L. Driscoll + 3 more
Viral mutation forecasting plays a key role in pandemic preparedness by enabling researchers to anticipate novel variants and design proactive interventions. Evolutionary histories, represented as phylogenetic trees, offer key insights into the emergence of past and present strains, yet their role in predicting future…
Lara B. Hillyard, Nancy Bunbury, Christopher N. Kaiser‐Bunbury, Dave Hodgson + 6 more
A core component of conservation management projects is the estimation and monitoring of abundance of target species, in space and through time. Monitoring wildlife is complicated and relies on detection, which itself depends on environmental conditions, phenotypes and behaviours of the species being monitored. Aldabra…