Cross-Modal Associations Between Color and Touch: Mapping Haptic and Tactile Terms to the Surface of the Munsell Color Solid
This study investigated cross-modal associations between color and touch using a matching task. Participants matched colors drawn from the surface of the Munsell color solid to antonym pairs of haptic/tactile adjectives. For most of the term pairs assessed (soft/hard,smooth/rough,flat/uneven,slippery/not slippery,light/heavy,thin/thick andround/sharp) matching appears predominantly influenced by lightness, with the first term from each pair matched to light colors and the other to dark colors, a result in close agreement with previous research. For two terms,warm andwet, there were clear influences of hue on task performan...
Source: Multisensory research - September 14, 2017 Category: Neuroscience Authors: Oliver Wright, Yasmina Jraissati and Dila Özçelik Source Type: research
Semantically Congruent Visual Stimuli Can Improve Auditory Memory (Advance Article)
Source:Page Count 13We investigated the effects of audiovisual semantic congruency on recognition memory performance. It has been shown previously that memory performance is better for semantically congruent stimuli that are presented together in different modalities (e.g., a dog ’s bark with a picture of the dog) during encoding, compared to stimuli presented together with an incongruent or non-semantic stimulus across modalities. We wanted to clarify whether this congruency effect is also present when the effects of response bias and uncertainty of stimulus type are remo ved. The participants memorized auditory or visu...
Source: Multisensory research - September 14, 2017 Category: Neuroscience Authors: Jenni Heikkil ä, Kimmo Alho and Kaisa Tiippana Source Type: research
[i] is Lighter and More Greenish Than [o]: Intrinsic Association Between Vowel Sounds and Colors (Advance Article)
Source:Page Count 19It has recently been reported in the synesthesia literature that graphemes sharing the same phonetic feature tend to induce similar synesthetic colors. In the present study, we investigated whether phonetic properties are associated with colors in a specific manner among the general population, even when other visual and linguistic features of graphemes are removed. To test this hypothesis, we presented vowel sounds synthesized by systematically manipulating the position of the tongue body ’s center. Participants were asked to choose a color after hearing each sound. Results from the main experiment s...
Source: Multisensory research - September 14, 2017 Category: Neuroscience Authors: Hyun-Woong Kim, Hosung Nam and Chai-Youn Kim Source Type: research
Electrophysiological Indices of Audiovisual Speech Perception: Beyond the McGurk Effect and Speech in Noise
Source:Page Count 18Visual information on a talker ’s face can influence what a listener hears. Commonly used approaches to study this include mismatched audiovisual stimuli (e.g., McGurk type stimuli) or visual speech in auditory noise. In this paper we discuss potential limitations of these approaches and introduce a novel visual phonemic restor ation method. This method always presents the same visual stimulus (e.g., /ba/) dubbed with a matched auditory stimulus (/ba/) or one that has weakened consonantal information and sounds more /a/-like). When this reduced auditory stimulus (or /a/) is dubbed with the visual /ba/...
Source: Multisensory research - September 14, 2017 Category: Neuroscience Authors: Julia Irwin, Trey Avery, Lawrence Brancazio, Jacqueline Turcios, Kayleigh Ryherd and Nicole Landi Source Type: research
Reducing Playback Rate of Audiovisual Speech Leads to a Surprising Decrease in the McGurk Effect
We report the unexpected finding that slowing video playback decreases perception of the McGurk effect. This reduction is counter-intuitive because the illusion depends on visual speech influencing the perception of auditory speech, and slowing speech should increase the amount of visual information available to observers. We recorded perceptual data from 110 subjects viewing audiovisual syllables (either McGurk or congruent control stimuli) played back at one of three rates: the rate used by the talker during recording (the natural rate), a slow rate (50% of natural), or a fast rate (200% of natural). We replicated previo...
Source: Multisensory research - September 13, 2017 Category: Neuroscience Authors: John F. Magnotti, Debshila Basu Mallick and Michael S. Beauchamp Source Type: research
How Prior Expectations Influence Older Adults ’ Perception and Action During Object Interaction
Source:Page Count 16The apparent size of an object can influence how we interact with and perceive the weight of objects in our environment. Little is known, however, about how this cue affects behaviour across the lifespan. Here, in the context of the size –weight illusion, we examined how visual size cues influenced the predictive application of fingertip forces and perceptions of heaviness in a group of older participants. We found that our older sample experienced a robust size–weight illusion, which did not differ from that experienced by youn ger participants. Older and young participants also experienced a real ...
Source: Multisensory research - September 13, 2017 Category: Neuroscience Authors: Gavin Buckingham, Darren Reid and Lauren M. Potter Source Type: research
Reciprocal Interference Between Audition and Touch in the Perception of Duration (Advance Article)
Source:Page Count 21Audition and touch interact with one another and share a number of similarities; however, little is known about their interplay in the perception of temporal duration. The present study intended to investigate whether the temporal duration of an irrelevant auditory or tactile stimulus could modulate the perceived duration of a target stimulus presented in the other modality (i.e., tactile or auditory) adopting both a between-participants (Experiment 1) and a within-participants (Experiment 2) experimental design. In a two-alternative forced-choice task, participants decided which of two events in a t...
Source: Multisensory research - September 13, 2017 Category: Neuroscience Authors: Lia Villanueva and Massimiliano Zampini Source Type: research
Individual Differences in Sensory Substitution
Source:Volume 30, Issue 6, pp 579 - 600Sensory substitution devices were developed in the context of perceptual rehabilitation and they aim at compensating one or several functions of a deficient sensory modality by converting stimuli that are normally accessed through this deficient sensory modality into stimuli accessible by another sensory modality. For instance, they can convert visual information into sounds or tactile stimuli. In this article, we review those studies that investigated the individual differences at the behavioural, neural, and phenomenological levels when using a sensory substitution device. We highli...
Source: Multisensory research - August 2, 2017 Category: Neuroscience Authors: Gabriel Arnold, Jacques Pesnot-Lerousseau and Malika Auvray Source Type: research
Individual Alpha Frequency Relates to the Sound-Induced Flash Illusion
Source:Volume 30, Issue 6, pp 565 - 578Ongoing neural oscillations reflect fluctuations of cortical excitability. A growing body of research has underlined the role of neural oscillations for stimulus processing. Neural oscillations in the alpha band have gained special interest in electrophysiological research on perception. Recent studies proposed the idea that neural oscillations provide temporal windows in which sensory stimuli can be perceptually integrated. This also includes multisensory integration. In the current high-density EEG-study we examined the relationship between the individual alpha frequency (IAF) and c...
Source: Multisensory research - August 2, 2017 Category: Neuroscience Authors: Julian Keil and Daniel Senkowski Source Type: research
Multisensory Integration in Migraine: Recent Developments
Source:Volume 30, Issue 6, pp 549 - 563There are well-documented unimodal sensory differences in migraine compared to control groups both during, and between migraine attacks. There is also some evidence of multisensory integration differences in migraine groups compared to control groups, however the literature on this topic is more limited. There are interesting avenues in the area of visual –vestibular integration, which might have practical implications, e.g., motion sickness and nausea in migraine. Recent work has been investigating the possibility of visual–auditory integration in migraine, and found possible dif...
Source: Multisensory research - August 2, 2017 Category: Neuroscience Authors: Louise O ’Hare Source Type: research
Introduction to the Special Issue on Individual Differences in Multisensory Perception: an Overview
Source:Volume 30, Issue 6, pp 461 - 466The world is full of objects that can be perceived through multiple different senses to create an integrated understanding of our environment. Since each of us has different biological and psychological characteristics, different people may perceive the world in quite different ways. However, the questions of how and why our multisensory perceptions differ have not been explored in any great depth. This special issue, arising from a series of British Psychological Society-funded seminars, presents new research and opinions on the impacts of a variety of individual differences on multi...
Source: Multisensory research - August 2, 2017 Category: Neuroscience Authors: Clare Jonas, Mary Jane Spiller, Paul B. Hibbard and Michael Proulx Source Type: research
Developmental Changes in Sensitivity to Spatial and Temporal Properties of Sensory Integration Underlying Body Representation
Source:Page Count 18The closer in time and space that two or more stimuli are presented, the more likely it is that they will be integrated together. A recent study by Hillock-Dunn and Wallace (2012) reported that the size of the visuo-auditory temporal binding window — the interval within which visual and auditory inputs are highly likely to be integrated — narrows over childhood. However, few studies have investigated how sensitivity to temporal and spatial properties of multisensory integration underlying body representation develops in children. This is n ot only important for sensory processes but has also been ar...
Source: Multisensory research - July 24, 2017 Category: Neuroscience Authors: Katie Greenfield, Danielle Ropar, Kristy Themelis, Natasha Ratcliffe and Roger Newport Source Type: research
The Relationship Between Sound –Shape Matching and Cognitive Ability in Adults With Down Syndrome
This study aimed to characterise sound –shape matching performance in young adults with DS as an indicator of MSI (correct response rate around 90% in typically developing individuals). We further investigated the relationship between task performance and estimated cognitive ability (verbal and non-verbal) in addition to everyday adapt ive behavior skills. Those answering correctly (72.5%) scored significantly higher across cognitive and adaptive behavior measures compared to those answering incorrectly. Furthermore, 57.1% of individuals with estimated cognitive ability scores below the median value answered correctly co...
Source: Multisensory research - June 30, 2017 Category: Neuroscience Authors: S. Hamburg, C. M. Startin and A. Strydom Source Type: research
Higher Emotional Intelligence Is Associated With a Stronger Rubber Hand Illusion
Source:Page Count 23The aim of the study was to investigate how emotion information processing factors, such as alexithymia and emotional intelligence, modulate body ownership and influence multisensory integration during the ‘rubber hand illusion’ (RHI) task. It was previously shown that alexithymia correlates with RHI, and we suggested that emotional intelligence should also be a top-down factor of body ownership, since it was not shown in previous experiments. We elaborated the study of Grynberg and Pollatos [Front. Hum. Neurosci.9 (2015) 357] with an additional measure of emotional intelligence, and propose an expl...
Source: Multisensory research - June 28, 2017 Category: Neuroscience Authors: Olga Perepelkina, Maria Boboleva, Galina Arina and Valentina Nikolaeva Source Type: research
Grasping and Pointing — Visual Conflict and Interference (Advance Article)
Source:Page Count 16There have been many debates of the two-visual-systems (whatvs. how or perceptionvs. action) hypothesis that was proposed by Goodale and his colleagues. Many researchers have provided a variety of evidence for or against the hypothesis. For instance, a study performed by Agliotiet al. offered good evidence for the two-visual-systems theory using the Ebbinghaus illusion, but some researchers who used other visual illusions failed to find consistent results. Therefore, we used a perceptual task of conflict or interference to test this hypothesis. If the conflict or interference in perception had an influe...
Source: Multisensory research - June 27, 2017 Category: Neuroscience Authors: Xia Shi, Xunbing Shen and Xiuying Qian Source Type: research
