21 papers · ranked by Valyu relevance
Jiabei Zhang, Qi Wang, Shengxi Wu, Chen Du + 1 more
Perceptual optimization is primarily driven by the fidelity objective, which enforces both semantic consistency and overall visual realism, while the adversarial objective provides complementary refinement by enhancing perceptual sharpness and fine-grained detail. Despite their central role, the correlation between…
Zining Zhu, Liang Zhao, Kaili Lin, Jinze Yang + 6 more
'Chenglong Liu' 'Haoran Wei' 'Jianjian Sun' 'Zheng Ge' 'Xiangyu Zhang'] This paper presents Perceptual Preference Optimization (PerPO), a perception alignment method aimed at addressing the visual discrimination challenges in generative pre-trained multimodal large language models (MLLMs). To align MLLMs with human…
Dobromir Rahnev, Rachel Denison
Human perception is increasingly described as optimal. This view reflects recent successes of Bayesian approaches to perception but ignores an extensive literature documenting suboptimal performance in perceptual tasks. Here we review several classes of suboptimal perceptual decisions, including improper placement…
Franklin Leong, Silvestro Micera, Solaiman Shokur
Restoring natural sensation via neuroprosthetics relies on the possibility of encoding complex and nuanced information. For example, an ideal brain-machine interface with sensory feedback would provide the user with sensation about movement, pressure, curvature, texture, etc. Despite advances in neural interfaces that…
Miša Korać, Corentin Salaün, Iliyan Georgiev, Pascal Grittmann + 3 more
In summary, in this section we have presented a perception-driven model (3) to assess the spatio-temporal quality of a sample sequence. We model human perception by a series of convolutions, and (optionally) include explicit temporal filtering (TAA). In our main results we use this objective for a priori sample…
Tristan Fauvel, Matthew Chalk
Retinal prostheses are a promising strategy to restore sight to patients with retinal degenerative diseases. These devices compensate for the loss of photoreceptors by electrically stimulating neurons in the retina. Currently, the visual function that can be recovered with such devices is very limited. This is due, in…
Burcu Küçükoğlu, Leili Soo, David Leeftink, Fabrizio Grani + 4 more
The challenge in cortical neuroprosthetic vision is determining the optimal, safe stimulation patterns for the visual cortex in order to evoke the desired perception in blind individuals—specifically, light perceptions known as phosphenes. Currently, clinical studies gain insights into the perceptual characteristics of…
Kaan Akşit, Ahmet Barış Güzel, Jeanne Beyazian, Praneeth Chakravarthula
In the final step, we aim to optimize an image which, after passing through the eye's optical system (modelled as a convolution in Eq. 7), is intended to produce a retinal image that is as close as possible to the ground truth image. This is done by solving the optimization problem, $s^{\prime}\leftarrow$ argmin…
Vassillen Chizhov, Iliyan Georgiev, Karol Myszkowski, Gurprit Singh
We now describe the second, "horizontal" discrete variant of our minimization formulation (5). It considers a single sample set assigned to each of the pixels, all represented together as a sampleset image . The search space comprises all possible permutations Π( ) of these assignments: $\Omega=\Pi(\mathbf{S})$, with…
Yafeng Zhao, Xiang Li, Shuaipeng Hao, Min Yu + 4 more
In edge deployment scenarios, low-light image enhancement faces a trade-off between model complexity and perceptual quality, limiting lightweight models under resource constraints. To address this problem, this paper proposes a perceptual quality optimization model inspired by biological visual mechanisms.…
Jaap de Ruyter van Steveninck, Umut Güçlü, Richard van Wezel, Marcel van Gerven
Neural prosthetics may provide a promising solution to restore visual perception in some forms of blindness. The restored prosthetic percept is rudimentary compared to normal vision and can be optimized with a variety of image preprocessing techniques to maximize relevant information transfer. Extracting the most…
Romy Lorenz, Laura E. Simmons, Ricardo P. Monti, Joy L. Arthur + 4 more
'Severin Limal' 'Ilkka Laakso' 'Robert Leech' 'Ines R. Violante'] Background Selecting optimal stimulation parameters from numerous possibilities is a major obstacle for assessing the efficacy of non-invasive brain stimulation. Objective We demonstrate that Bayesian optimization can rapidly search through large…
Jacob Granley, Tristan Fauvel, Matthew Chalk, Michael Beyeler
Neuroprostheses show potential in restoring lost sensory function and enhancing human capabilities, but the sensations produced by current devices often seem unnatural or distorted. Exact placement of implants and differences in individual perception lead to significant variations in stimulus response, making…
Jaap de Ruyter van Steveninck, Umut Güçlü, Richard van Wezel, Marcel van Gerven
'Marcel van Gerven'] Neural prosthetics may provide a promising solution to restore visual perception in some forms of blindness. The restored prosthetic percept is rudimentary compared to normal vision and can be optimized with a variety of image preprocessing techniques to maximize relevant information transfer.…
Christopher W. Tyler
This overview discusses the nature of perceptual illusions with particular reference to the theory that illusions represent the operation of a sensory code for which there is no meaningful ground truth against which the illusory percepts can be compared, and therefore there are no illusions as such. This view…
Authors not listed
This paper formally defines an operational isomorphism between spectral damping in molecular vibronic systems and neuromodulatory control in biological sensory systems. Without asserting causal continuity or physical identity across scales, we show that both domains instantiate the same class of output-selective…
Authors not listed
Machine olfaction—the artificial replication of the sense of smell—faces significant challenges due to the absence of large, standardized training datasets. Unlike vision, language, and audio models, which benefit from extensive corpora such as ImageNet, GLUE, and AudioSet, olfaction lacks scaled equivalents and…
Kenichi Ito, Hiroshi Higashi, Ari Hietanen, Pauli Fält + 8 more
'Markku Hauta-Kasari' 'Shigeki Nakauchi' 'Vincenzo Conti' 'Carmelo Militello' 'Wellington Pinheiro Dos Santos' 'Ganesh Naik' 'Nicole Dalia Cilia'] Any change in the light-source spectrum modifies the color information of an object. The spectral distribution of the light source can be optimized to enhance specific…
Authors not listed
Solving optimization problems, especially for nonlinear and constrained systems, is a challenge. Decades of specialized algorithms have been developed for general and special cases of root finding, minimization (including constraints), for parameter estimation, and mapping connected spaces. These approaches typically…
Lucian Chan, Geoffrey Hutchison, Garrett Morris
Generating low-energy molecular conformers is a key task for many areas of computational chemistry, molecular modeling and cheminformatics. Most current conformer generation methods primarily focus on generating geometrically diverse conformers rather than finding the most probable or energetically lowest minima. Here…
Riley Hickman, Priyansh Parakh, Austin Cheng, Qianxiang Ai + 3 more
Experiment planning algorithms are a required component of autonomous platforms for scientific discovery. Selecting a suitable optimization algorithm for a novel application is an important yet difficult choice a researcher has to make based on past empirical performance on similar tasks. To facilitate the evaluation…