20 papers · ranked by Valyu relevance
Jiabei Zhang, Qi Wang, Shengxi Wu, Chen Du + 1 more
Perceptual optimization is primarily driven by the fidelity objective, which enforces both semantic consistency and overall visual realism, while the adversarial objective provides complementary refinement by enhancing perceptual sharpness and fine-grained detail. Despite their central role, the correlation between…
Tristan Fauvel, Matthew Chalk
Retinal prostheses are a promising strategy to restore sight to patients with retinal degenerative diseases. These devices compensate for the loss of photoreceptors by electrically stimulating neurons in the retina. Currently, the visual function that can be recovered with such devices is very limited. This is due, in…
Zining Zhu, Liang Zhao, Kaili Lin, Jinze Yang + 6 more
'Chenglong Liu' 'Haoran Wei' 'Jianjian Sun' 'Zheng Ge' 'Xiangyu Zhang'] This paper presents Perceptual Preference Optimization (PerPO), a perception alignment method aimed at addressing the visual discrimination challenges in generative pre-trained multimodal large language models (MLLMs). To align MLLMs with human…
Vassillen Chizhov, Iliyan Georgiev, Karol Myszkowski, Gurprit Singh
We now describe the second, "horizontal" discrete variant of our minimization formulation (5). It considers a single sample set assigned to each of the pixels, all represented together as a sampleset image . The search space comprises all possible permutations Π( ) of these assignments: $\Omega=\Pi(\mathbf{S})$, with…
Franklin Leong, Silvestro Micera, Solaiman Shokur
Restoring natural sensation via neuroprosthetics relies on the possibility of encoding complex and nuanced information. For example, an ideal brain-machine interface with sensory feedback would provide the user with sensation about movement, pressure, curvature, texture, etc. Despite advances in neural interfaces that…
Miša Korać, Corentin Salaün, Iliyan Georgiev, Pascal Grittmann + 3 more
In summary, in this section we have presented a perception-driven model (3) to assess the spatio-temporal quality of a sample sequence. We model human perception by a series of convolutions, and (optionally) include explicit temporal filtering (TAA). In our main results we use this objective for a priori sample…
Jaap de Ruyter van Steveninck, Umut Güçlü, Richard van Wezel, Marcel van Gerven
'Marcel van Gerven'] Neural prosthetics may provide a promising solution to restore visual perception in some forms of blindness. The restored prosthetic percept is rudimentary compared to normal vision and can be optimized with a variety of image preprocessing techniques to maximize relevant information transfer.…
Burcu Küçükoğlu, Leili Soo, David Leeftink, Fabrizio Grani + 4 more
The challenge in cortical neuroprosthetic vision is determining the optimal, safe stimulation patterns for the visual cortex in order to evoke the desired perception in blind individuals—specifically, light perceptions known as phosphenes. Currently, clinical studies gain insights into the perceptual characteristics of…
Kaan Akşit, Ahmet Barış Güzel, Jeanne Beyazian, Praneeth Chakravarthula
In the final step, we aim to optimize an image which, after passing through the eye's optical system (modelled as a convolution in Eq. 7), is intended to produce a retinal image that is as close as possible to the ground truth image. This is done by solving the optimization problem, $s^{\prime}\leftarrow$ argmin…
Yafeng Zhao, Xiang Li, Shuaipeng Hao, Min Yu + 4 more
In edge deployment scenarios, low-light image enhancement faces a trade-off between model complexity and perceptual quality, limiting lightweight models under resource constraints. To address this problem, this paper proposes a perceptual quality optimization model inspired by biological visual mechanisms.…
Zhong-Lin Lu, Shanglin Yang, Barbara Dosher
The Augmented Hebbian Reweighting Model (AHRM) has been effectively utilized to model the collective performance of observers in various perceptual learning studies. In this work, we have introduced a novel hierarchical Bayesian Augmented Hebbian Reweighting Model (HB-AHRM) to simultaneously model the learning curves…
Jacob Granley, Tristan Fauvel, Matthew Chalk, Michael Beyeler
Neuroprostheses show potential in restoring lost sensory function and enhancing human capabilities, but the sensations produced by current devices often seem unnatural or distorted. Exact placement of implants and differences in individual perception lead to significant variations in stimulus response, making…
Jing Wang, Rongfeng Zhao, Peitong Li, Zhiqiang Fang + 5 more
'Yanling Han' 'Ruyan Zhou' 'Yun Zhang' 'Francesca Uccheddu'] Visual prostheses, used to assist in restoring functional vision to the visually impaired, convert captured external images into corresponding electrical stimulation patterns that are stimulated by implanted microelectrodes to induce phosphenes and eventually…
Catherine A. Fromm, Krystel R. Huxlin, Ross K. Maddox, Melissa J. Polonenko + 1 more
Visual training improves performance in visually-intact and visually-impaired participants, making it useful as a rehabilitation tool. An interesting question in rehabilitation is whether invocation of multisensory integration could increase training efficacy. To investigate, participants completed a 10-day training…
Elsa Scialom, Udo A. Ernst, David Rotermund, Michael H. Herzog
Cortical prostheses offer the potential for partial vision restoration in individuals with blindness by stimulating V1 neurons to produce phosphenes. However, the low number of phosphenes that can be elicited in practice makes encoding of whole objects difficult, and the round shape of phosphenes lack the contour cues…
Christopher W. Tyler
This overview discusses the nature of perceptual illusions with particular reference to the theory that illusions represent the operation of a sensory code for which there is no meaningful ground truth against which the illusory percepts can be compared, and therefore there are no illusions as such. This view…
Jingyang Zhou, Chanwoo Chun
Perception is an outcome of neuronal computations. Our perception changes only when the underlying neuronal responses change. Because visual neurons preferentially respond to adjustments in some pixel values of an image more than others, our perception has greater sensitivity in detecting change to some pixel…
Authors not listed
This paper formally defines an operational isomorphism between spectral damping in molecular vibronic systems and neuromodulatory control in biological sensory systems. Without asserting causal continuity or physical identity across scales, we show that both domains instantiate the same class of output-selective…
Authors not listed
Machine olfaction—the artificial replication of the sense of smell—faces significant challenges due to the absence of large, standardized training datasets. Unlike vision, language, and audio models, which benefit from extensive corpora such as ImageNet, GLUE, and AudioSet, olfaction lacks scaled equivalents and…
Authors not listed
Solving optimization problems, especially for nonlinear and constrained systems, is a challenge. Decades of specialized algorithms have been developed for general and special cases of root finding, minimization (including constraints), for parameter estimation, and mapping connected spaces. These approaches typically…