26 papers · ranked by Valyu relevance
Authors not listed
Autoregressive large language models (LLMs) deliver strong performance but require inherently sequential decoding, leading to high inference latency and poor GPU utilization. Speculative decoding mitigates this bottleneck by using a fast draft model whose outputs are verified in parallel by the target LLM. However…
Liran Ringel, Yaniv Romano
Speculative decoding accelerates autoregressive language models by using a lightweight drafter to propose multiple future tokens, which the target model then verifies in parallel. DFlash shows that a block diffusion drafter can generate an entire draft block in a single forward pass and achieve state-of-the-art…
Jacob Christopher, Brian R. Bartoldson, Bhavya Kailkhura, Ferdinando Fioretto
Diffusion Authors: ['Jacob Christopher' 'Brian R. Bartoldson' 'Bhavya Kailkhura' 'Ferdinando Fioretto'] Speculative decoding has emerged as a widely adopted method to accelerate large language model inference without sacrificing the quality of the model outputs. While this technique has facilitated notable speed…
Valentin De Bortoli, Alexandre Galashov, Arthur Gretton, Arnaud Doucet
'Arnaud Doucet'] Speculative sampling is a popular technique for accelerating inference in Large Language Models by generating candidate tokens using a fast draft model and accepting or rejecting them based on the target model's distribution. While speculative sampling was previously limited to discrete sequences, we…
Kevin Clark, Paul Vicol, Kevin Swersky, David J. Fleet
We present Direct Reward Fine-Tuning (DRaFT), a simple and effective method for fine-tuning diffusion models to maximize differentiable reward functions, such as scores from human preference models. We first show that it is possible to backpropagate the reward function gradient through the full sampling procedure, and…
Zou, Zhen, Ma, Xiaoxiao + 6 more
Autoregressive(AR)-diffusion hybrid paradigms combine AR's structured modeling with diffusion's photorealistic synthesis, yet suffer from high latency due to sequential AR generation and iterative denoising. In this work, we tackle this bottleneck and propose a unified AR–diffusion framework Fast-ARDiff that jointly…
Kai Trepka
Building models of organismal growth enables predictions of natural variability and responses to perturbations. Complex systems such as animal pattern development and bacterial colonies can be modeled numerically using a reaction-diffusion system with relatively few factors and yield qualitatively accurate results…
Authors not listed
Direct air capture (DAC) using amine-functionalised adsorbents is a promising route to negative emissions. Here, we investigate how humidity influences the swelling, CO2 uptake, and mass transfer of two amine-functionalised polymeric resins, Lewatit VP OC 1065 and Purolite A110, using a combined experimental and…
Junkil Park, Aseem Partap Singh Gill, Seyed Mohamad Moosavi, JIHAN KIM
The success of diffusion models in the field of image processing has propelled the creation of software such as Dall-E, Midjourney and Stable Diffusion, which are tools used for text-to-image generations. Mapping this workflow onto materials discovery, a new diffusion model was developed for the generation of pure…
Sebastian Schmitt, Hans Hasse, Simon Stephan
Entropy scaling is a powerful technique that has been used successfully for predicting transport properties of pure components over a wide range of states. However, modeling mixture diffusion coefficients by entropy scaling is an unresolved task. We have tackled this issue and present an entropy scaling framework for…
Authors not listed
Lignin and carbohydrate rich secondary plant cell walls are abundantly available in the biosphere, and is a notable renewable feedstock for biofuels and biomaterials. Particularly for construction applications, wood that is resistant to fungal degradation is highly desirable. Chemical modifications, such as…
Yunyun Li, Vyacheslav R. Misko, Fabio Marchesoni, Pulak K. Ghosh + 1 more
'Johan Anderson'] We numerically investigate the transport of a Brownian colloidal particle in a square array of planar counter-rotating convection rolls at high Péclet numbers. We show that an external force produces huge excess peaks of the particle’s diffusion constant with a height that depends on the force…
Emmanuel Ren, François-Xavier Coudert
Nanoporous materials serve as very effective media for storing or separating small molecules. To design the best materials for a given application based on adsorption, one usually assesses the equilibrium performance by using key thermodynamic quantities such as Henry constants or adsorption loading values. To go…
Gang Xiong, Jesse N. Clark, Chris Nicklin, Jonathan Rawle + 1 more
'Ian K. Robinson'] Due to their excess surface free energy and structural instabilities, nanoparticles exhibit interesting physical and chemical properties. There has been an ever-growing interest in investigating these properties, driven by the desire to further miniaturize electronic devices, develop new functional…
Ioatzin Rios de Anda, Jake W. Wilkins, Joshua F. Robinson, C. Patrick Royall + 1 more
'C. Patrick Royall' 'Richard P. Sear'] During the COVID-19 pandemic, many millions have worn masks made of woven fabric to reduce the risk of transmission of COVID-19. Masks are essentially air filters worn on the face that should filter out as many of the dangerous particles as possible. Here, the dangerous particles…
Steven J. Moran, Ryan Oglietti, Kathleen C. Smith, Jed C. Macosko + 2 more
Viral and cellular particles too large to freely diffuse have two different types of mobility in the eukaryotic cell cytoplasm: directed motion mediated by motor proteins moving along cytoskeletal elements with the particle as its load, and motion in random directions mediated by motor proteins interconnecting…
G Achaz, E Schertzer
Recurrent selective sweeps reduce diversity at linked neutral loci, a regime known as genetic draft. Most theoretical work has focused on the tight draft regime, where the selected and neutral loci are closely linked, leading to Multiple Merger Coalescents and a diversity largely insensitive to population size. Here…
Authors not listed
The diffusion of CO2 and H2O in CALF-20 was examined at various concentrations and in N2 and He carrier gases. The data show that N2 has a measurable impact on the diffusion of CO2 and H2O in the pores of CALF-20. The results highlight the importance of considering N2 adsorption in CO2 capture materials and the effect…
Ge Peng, Fang Liu
Coronaviruses being capable of spreading through droplet contamination have raised significant concerns regarding high-capacity public rail transport, such as the metro. Within a rapidly moving railcar cabin, the internal airflow lags behind the bulkhead, generating internally induced airflow that accelerates droplet…
Yu-Chuan Chien, Haidong Liu, Ashok S. Menon, William R. Brant + 2 more
The galvanostatic intermittent titration technique (GITT) has been regarded as the go-to method for determining the diffusion coefficients of Li-ions in insertion electrode materials at various states of charge (SoC). However, the method is time-consuming. In this work, the intermittent current interruption (ICI)…
Sarthak Patnaik
We know that the diffusion is defined as the movement of molecules under a potential gradient. It is characterized by the diffusion coefficient. Diffusion coefficient determination can be done via various techniques, but in this paper, we have had a broad look at interferometry based optical methods for diffusion…
Taylor Kessinger, Jeremy Van Cleve
Living systems are characterized by complex adaptations which require multiple coordinated mutations in order to function. Empirical studies of fitness landscapes that result from the many possible mutations in a gene region reveal many fitness peaks and valleys that connect them. Thus, it is possible that some complex…
Yisheng Zhang, Wei Tang, Hao Li, Jinjun Guo + 3 more
'Yongfu Guo' 'Choong-Min Kang'] A large quantity of particulate matter is generated during construction of civil engineering projects, which has a negative effect on the atmosphere and environment. In order to explore the concentration, distribution and diffusion of particulate matters generated from construction dust…
Lei Zhu, Wenzhe Gu, Fengqi Qiu, Yibo Ouyang
To quantify the diffusion range of slurry in grouting engineering, an active heating optical fiber (AHFO) monitoring method is proposed. The AHFO is arranged on the coal seam floor. The temperature is taken as the monitoring parameter to monitor the diffusion range and state of slurry in the injected medium.…
Xuan Wang, Minghua Lv, Shuhuan Liu, Jing Li + 2 more
'Fanjun Meng'] This paper developed XJCT-3D, a simulation software for cooling tower wet plume dispersion. By coupling it with the Open GIS component Dotspatial, we have achieved geospatial visual representation of the calculation results, which has solved the problems of low calculation efficiency and insufficient…
Adam Diehl, Alan Boyle
Recent advancements in sequencing technologies have yielded numerous long-read draft genomes, promising to enhance understanding of genomic variation. However, draft genomes are typically highly fragmented, posing challenges for functional genomics. We introduce GPatch, a tool that constructs chromosome-scale…