Cross-modal sensory integration of visual-tactile motion information: Instrument design and human psychophysics

Yu Cheng Pei*, Ting Yu Chang, Tsung Chi Lee, Sudipta Saha, Hsin Yi Lai, Manuel Gomez-Ramirez, Shih Wei Chou, Alice M.K. Wong

*Corresponding author for this work

Research output: Contribution to journalJournal Article peer-review

10 Scopus citations


Information obtained from multiple sensory modalities, such as vision and touch, is integrated to yield a holistic percept. As a haptic approach usually involves cross-modal sensory experiences, it is necessary to develop an apparatus that can characterize how a biological system integrates visual-tactile sensory information as well as how a robotic device infers object information emanating from both vision and touch. In the present study, we develop a novel visual-tactile cross-modal integration stimulator that consists of an LED panel to present visual stimuli and a tactile stimulator with three degrees of freedom that can present tactile motion stimuli with arbitrary motion direction, speed, and indentation depth in the skin. The apparatus can present cross-modal stimuli in which the spatial locations of visual and tactile stimulations are perfectly aligned. We presented visual-tactile stimuli in which the visual and tactile directions were either congruent or incongruent, and human observers reported the perceived visual direction of motion. Results showed that perceived direction of visual motion can be biased by the direction of tactile motion when visual signals are weakened. The results also showed that the visual-tactile motion integration follows the rule of temporal congruency of multi-modal inputs, a fundamental property known for cross-modal integration.

Original languageEnglish
Pages (from-to)7212-7223
Number of pages12
Issue number6
StatePublished - 06 2013
Externally publishedYes


  • Congruency
  • Direction of motion
  • Haptic approach
  • Tactile stimulator
  • Visual-tactile integration


Dive into the research topics of 'Cross-modal sensory integration of visual-tactile motion information: Instrument design and human psychophysics'. Together they form a unique fingerprint.

Cite this