Exploring crossmodal perceptual enhancement and integration in a sequence-reproducing task with cognitive priming

Abstract

Leveraging the perceptual phenomenon of crossmodal correspondence has been shown to facilitate peoples information processing and improves sensorymotor performance. However, for goal-oriented interactive tasks, the question of how to enhance the perception of specific crossmodal information, and how crossmodal information integration takes place during interaction, is still unclear. The present paper reports two experiments investigating these questions. In Experiment 1, a cognitive priming technique was introduced as a way to enhance the perception of two crossmodal stimuli, the pitch-brightness and the pitch-elevation stimuli, in two conditions respectively, and their effect on sensory-motor performance was observed. Based on the results, experiment 2 combined the two crossmodal stimuli in the same interfaces in a way that their correspondence congruency was mutually exclusive. The same priming technique was applied as a manipulating factor to observe the crossmodal integration process. Results showed that first, people's crossmodal perception during interaction can be enhanced by the priming technique, but the effect varies according to the combination of crossmodal stimuli and the types of priming material. Moreover, people's subjective evaluations to-