12 papers · ranked by Valyu relevance
Jiabei Zhang, Qi Wang, Shengxi Wu, Chen Du + 1 more
Perceptual optimization is primarily driven by the fidelity objective, which enforces both semantic consistency and overall visual realism, while the adversarial objective provides complementary refinement by enhancing perceptual sharpness and fine-grained detail. Despite their central role, the correlation between…
Zining Zhu, Liang Zhao, Kaili Lin, Jinze Yang + 6 more
'Chenglong Liu' 'Haoran Wei' 'Jianjian Sun' 'Zheng Ge' 'Xiangyu Zhang'] This paper presents Perceptual Preference Optimization (PerPO), a perception alignment method aimed at addressing the visual discrimination challenges in generative pre-trained multimodal large language models (MLLMs). To align MLLMs with human…
Vassillen Chizhov, Iliyan Georgiev, Karol Myszkowski, Gurprit Singh
We now describe the second, "horizontal" discrete variant of our minimization formulation (5). It considers a single sample set assigned to each of the pixels, all represented together as a sampleset image . The search space comprises all possible permutations Π( ) of these assignments: $\Omega=\Pi(\mathbf{S})$, with…
Farhad Pakdaman, Sanaz Nami, Moncef Gabbouj
Optimization Authors: ['Farhad Pakdaman' 'Sanaz Nami' 'Moncef Gabbouj'] Emerging Learned image Compression (LC) achieves significant improvements in coding efficiency by end-to-end training of neural networks for compression. An important benefit of this approach over traditional codecs is that any optimization…
Feng Ding, Jian Jin, Lili Meng, Weisi Lin
Recently, learned image compression schemes have achieved remarkable improvements in image fidelity (e.g., PSNR and MS-SSIM) compared to conventional hybrid image coding ones due to their high-efficiency non-linear transform, end-to-end optimization frameworks, etc. However, few of them take the Just Noticeable…
Miša Korać, Corentin Salaün, Iliyan Georgiev, Pascal Grittmann + 3 more
In summary, in this section we have presented a perception-driven model (3) to assess the spatio-temporal quality of a sample sequence. We model human perception by a series of convolutions, and (optionally) include explicit temporal filtering (TAA). In our main results we use this objective for a priori sample…
Kaan Akşit, Ahmet Barış Güzel, Jeanne Beyazian, Praneeth Chakravarthula
In the final step, we aim to optimize an image which, after passing through the eye's optical system (modelled as a convolution in Eq. 7), is intended to produce a retinal image that is as close as possible to the ground truth image. This is done by solving the optimization problem, $s^{\prime}\leftarrow$ argmin…
Cara Tursun, Piotr Didyk
The continuous improvements in display technology increase our ability to meet the perceptual capabilities of human visual perception, leading to a more realistic, engaging, and immersive user experience. Unfortunately, hardware developments also lead to more challenges regarding content creation and optimization…
Samuel Fernández-Menduiña, Eduardo Pavéz, Antonio Ortega
Most codec designs rely on the mean squared error (MSE) as a fidelity metric in rate-distortion optimization, which allows to choose the optimal parameters in the transform domain but may fail to reflect perceptual quality. Alternative distortion metrics, such as the structural similarity index (SSIM), can be computed…
Jacob Granley, Tristan Fauvel, Matthew Chalk, Michael Beyeler
Neuroprostheses show potential in restoring lost sensory function and enhancing human capabilities, but the sensations produced by current devices often seem unnatural or distorted. Exact placement of implants and differences in individual perception lead to significant variations in stimulus response, making…
Li Zhaoping
Our brain recognizes only a tiny fraction of sensory input, due to an information processing bottleneck. This blinds us to most visual inputs. Since we are blind to this blindness, only a recent framework highlights this bottleneck by formulating vision as mainly looking and seeing. Looking selects a tiny fraction of…
Luca Surace, Jorge Condor, Piotr Didyk
We also verify that our adjustments in brightness are subtle or imperceptible. While our method primarily focuses on preserving spatial contrast, ensuring temporal coherence is important to prevent artifacts resulting from excessively steep brightness modulation rates. The stimuli utilized in this subjective experiment…