28 papers · ranked by Valyu relevance
Jessica Freiherr, Johan N. Lundström, Ute Habel, Kathrin Reetz
The rapid demographical shift occurring in our society implies that understanding of healthy aging and age-related diseases is one of our major future challenges. Sensory impairments have an enormous impact on our lives and are closely linked to cognitive functioning. Due to the inherent complexity of sensory…
Monica Gori, Giulio Sandini
Painting comes from the desire to create through movement and color a non-existent image, making it real. To create a new pictorial composition, a close harmony between the creative process and the motor act is necessary. The technique represents the ability to generate motor actions and to interpret the “language” of…
Tayfun Lloyd-Esenkaya, Vanessa Lloyd-Esenkaya, Eamonn O’Neill, Michael J. Proulx
'Michael J. Proulx'] Sensory substitution techniques are perceptual and cognitive phenomena used to represent one sensory form with an alternative. Current applications of sensory substitution techniques are typically focused on the development of assistive technologies whereby visually impaired users can acquire…
F. N. Newell, E. McKenna, M. A. Seveso, I. Devine + 3 more
'R. J. Hirst' "A. O'Dowd"] Although object categorization is a fundamental cognitive ability, it is also a complex process going beyond the perception and organization of sensory stimulation. Here we review existing evidence about how the human brain acquires and organizes multisensory inputs into object…
Tiziana M. Florio, Koichi Hiraoka
This article delves into the intricate mechanisms underlying sensory integration in the executive control of movement, encompassing ideomotor activity, predictive capabilities, and motor control systems. It examines the interplay between motor and sensory functions, highlighting the role of the cortical and subcortical…
Pingping Jiang, Christopher Kent, Jonathan Rossiter, Shenbing Kuang
Multimodal perception is the predominant means by which individuals experience and interact with the world. However, sensory dysfunction or loss can significantly impede this process. In such cases, cross-modality research offers valuable insight into how we can compensate for these sensory deficits through sensory…
Masato Hirano, Shinichi Furuya
Fine-tuned sensory functions are bases of efficient motor control and learning and typically characterize skilled individuals. Although numerous studies demonstrated enhanced unimodal sensory functions at both neural and behavioral levels in skilled individuals, little is known about their multisensory interaction…
Maria Casado-Palacios, Alessia Tonelli, Claudio Campus, Monica Gori
When engaging with the environment, multisensory cues interact and are integrated to create a coherent representation of the world around us, process that has been suggested to be affected by the lack of visual feedback in blind individuals. In addition, the presence of voluntary movement seems to be responsible for…
German I. Parisi, Jonathan Tong, Pablo Barros, Brigitte Röder + 1 more
'Stefan Wermter'] Abstract—Our daily perceptual experience is driven by different neural mechanisms that yield multisensory interaction as the interplay between exogenous stimuli and endogenous expectations. While the interaction of multisensory cues according to their spatiotemporal properties and the formation of…
Nadia Bolognini, Cristina Russo, Giuseppe Vallar
In everyday life, many diverse bits of information, simultaneously derived from the different sensory channels, converge into discrete brain areas, and are ultimately synthetized into unified percepts. Such multisensory integration can dramatically alter the phenomenal experience of both environmental events and our…
Yu Hu, Yalda Mohsenzadeh
Our brain seamlessly integrates distinct sensory information to form a coherent percept. However, when real-world audiovisual events are perceived, the specific brain regions and timings for processing different levels of information remain less investigated. To address that, we curated naturalistic videos and recorded…
Guandong Wang, David Alais
Spatial frequency is a fundamental feature in both visual and somatosensory perception, yet how these modalities integrate spatial frequency information remains unclear. This study investigates whether visuotactile spatial frequency perception follows the principles of Maximum Likelihood Estimation (MLE) and whether…
Di Fu, Pablo Barros, German I. Parisi, Haiyan Wu + 3 more
'Xun Liu' 'Stefan Wermter'] Abstract— The efficient integration of multisensory observations is a key property of the brain that yields the robust interaction with the environment. However, artificial multisensory perception remains an open issue especially in situations of sensory uncertainty and conflicts. In this…
James Negen, Laura-Ashleigh Bird, Heather Slater, Lore Thaler + 1 more
People can learn new sensory skills that augment their perception, such as human echolocation. However, it is not clear to what extent these can become an integral part of the perceptual repertoire. Can they show automatic use, integrated with the other senses, or do they remain cognitively-demanding, cumbersome, and…
Ifeoma Nwogu, Goker Erdogan, Ilker Yildirim, Robert Jacobs
This paper presents a computational model of concept learning using Bayesian inference for a grammatically structured hypothesis space, and test the model on multisensory (visual and haptics) recognition of 3D objects. The study is performed on a set of artificially generated 3D objects known as fribbles, which are…
Alina Striner
As the internet of things (IoT) has integrated physical and digital technologies, designing for multiple sensory media ("mulsemedia") has become more attainable. Designing technology for multiple senses has the capacity to improve virtual realism, extend our ability to process information, and more easily transfer…
Takuma Maki, Hideyoshi YANAGISAWA
Throughout the course of product experience, a user employs multiple senses, including vision, hearing, and touch. Previous cross-modal studies have shown that multiple senses interact with each other and change perceptions. In this paper, we propose a methodology for designing multisensory product experiences by…
Gabriel Clouston, Matt Davidson, David Alais
Investigating sensory processes in active human observers is critical for a holistic understanding of perception. Recent research has demonstrated that locomotion can alter visual detection performance in a rhythmic manner, illustrating how a very frequent and natural behaviour can influence sensory performance. Here…
W. Paul Boyce, Tony Lindsay, Arkady Zgonnikov, Iñaki Rañó + 1 more
'KongFatt Wong‐Lin'] Abstract–Multimodal integration is an important process in perceptual decision-making. In humans, this process has often been shown to be statistically optimal, or near optimal: sensory information is combined in a fashion that minimises the average error in perceptual representation of stimuli.…
Hyunyoung Jang, Jinwook Kim, Jeongmi Lee
Virtual Reality Hand-Retargeted Interaction Authors: ['Hyunyoung Jang' 'Jinwook Kim' 'Jeongmi Lee'] Retargeting methods that modify the visual representation of real movements have been widely used to expand the interaction space and create engaging virtual reality experiences. For optimal user experience and…
Anastasia Maria Kesoglou, Kyriaki Mikellidou
Our brain is skilled with the ability to perceive and process multimodal stimuli. This process known as crossmodal perceptual integration, has been in the research spotlight for a long time, providing evidence for the integration of information coming from different modalities. Prior research mostly utilized pictures…
Feng Feng, Puhong Li, Tony Stockman
Leveraging the perceptual phenomenon of crossmodal correspondence has been shown to facilitate peoples information processing and improves sensorymotor performance. However, for goal-oriented interactive tasks, the question of how to enhance the perception of specific crossmodal information, and how crossmodal…
Randolph Maynes, Ryan Faulkner, Grace Callahan, Callie E. Mims + 3 more
'Saurabh Ranjan' 'Justine Stalzer' 'Brian Odegaard'] Hundreds (if not thousands) of multisensory studies provide evidence that the human brain can integrate temporally and spatially discrepant stimuli from distinct modalities into a singular event. This process of multisensory integration is usually portrayed in the…
Lampros Androutsos, Lorenzo Pallante, Agorakis Bompotas, Filip Stojceski + 8 more
Taste perception plays a pivotal role in guiding nutrient intake and aiding in the avoidance of potentially harmful substances through five basic tastes - sweet, bitter, umami, salty, and sour. Taste perception originates from molecular interactions in the oral cavity between taste receptors and chemical tastants.…
Authors not listed
We report a reusable cross-reactive plasmonic sensing system that generates unique optical fingerprints for any liquid mixture. The platform leverages a multiplexed plasmonic chip and methodology for creating 24 orthogonally modified sensors, coupled with hyperspectral imaging. We demonstrate the versatility and…
Authors not listed
Machine olfaction—the artificial replication of the sense of smell—faces significant challenges due to the absence of large, standardized training datasets. Unlike vision, language, and audio models, which benefit from extensive corpora such as ImageNet, GLUE, and AudioSet, olfaction lacks scaled equivalents and…
Authors not listed
This research delves into olfaction, a sensory modality that remains complex and inadequately understood. We aim to fill in two gaps in recent studies that attempted to use machine learning and deep learning approaches to predict human smell perception. The first one is that molecules are usually represented with…
Vinicius Santana, Erbet Costa, Carine Rebello, Ana Mafalda Ribeiro + 2 more
This study presents an innovative framework for classifying and predicting odor intensity in perfumery, combining scientific machine learning with mechanistic modeling to enhance fragrance design precision. A probabilistic weight assignment is introduced, utilizing scent classifier outputs to determine the contribution…