Early Integration Processing between Faces and Vowel Sounds in Human Brain

An MEG Investigation

Itta Nakamura, Yoji Hirano, Naotoshi Ohara, Shogo Hirano, Takefumi Ueno, Rikako Tsuchimoto, Shigenobu Kanba, Toshiaki Onitsuka

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

Objective: Unconscious fast integration of face and voice information is a crucial brain function necessary for communicating effectively with others. Here, we investigated for evidence of rapid face-voice integration in the auditory cortex. Methods: Magnetic fields (P50m and N100m) evoked by visual stimuli (V), auditory stimuli (A) and audiovisual stimuli (VA), i.e. by face, vowel and simultaneous vowel-face stimuli, were recorded in 22 healthy subjects. Magnetoencephalographic data from 28 channels around bilateral auditory cortices were analyzed. Results: In both hemispheres, AV - V showed significantly larger P50m amplitudes than A. Additionally, compared with A, the N100m amplitudes and dipole moments of AV - V were significantly smaller in the left hemisphere, but not in the right hemisphere. Conclusions: Differential changes in P50m (bilateral) and N100m (left hemisphere) that occur when V (faces) are associated with A (vowel sounds) indicate that AV (face-voice) integration occurs in early processing, likely enabling us to communicate effectively in our lives.

Original languageEnglish
Pages (from-to)187-195
Number of pages9
JournalNeuropsychobiology
Volume71
Issue number4
DOIs
Publication statusPublished - Sep 1 2015

Fingerprint

Brain
Auditory Cortex
Magnetic Fields
Healthy Volunteers

All Science Journal Classification (ASJC) codes

  • Neuropsychology and Physiological Psychology
  • Psychiatry and Mental health
  • Biological Psychiatry

Cite this

Early Integration Processing between Faces and Vowel Sounds in Human Brain : An MEG Investigation. / Nakamura, Itta; Hirano, Yoji; Ohara, Naotoshi; Hirano, Shogo; Ueno, Takefumi; Tsuchimoto, Rikako; Kanba, Shigenobu; Onitsuka, Toshiaki.

In: Neuropsychobiology, Vol. 71, No. 4, 01.09.2015, p. 187-195.

Research output: Contribution to journalArticle

@article{b898f7d49df340ab8ea0f98820bbed85,
title = "Early Integration Processing between Faces and Vowel Sounds in Human Brain: An MEG Investigation",
abstract = "Objective: Unconscious fast integration of face and voice information is a crucial brain function necessary for communicating effectively with others. Here, we investigated for evidence of rapid face-voice integration in the auditory cortex. Methods: Magnetic fields (P50m and N100m) evoked by visual stimuli (V), auditory stimuli (A) and audiovisual stimuli (VA), i.e. by face, vowel and simultaneous vowel-face stimuli, were recorded in 22 healthy subjects. Magnetoencephalographic data from 28 channels around bilateral auditory cortices were analyzed. Results: In both hemispheres, AV - V showed significantly larger P50m amplitudes than A. Additionally, compared with A, the N100m amplitudes and dipole moments of AV - V were significantly smaller in the left hemisphere, but not in the right hemisphere. Conclusions: Differential changes in P50m (bilateral) and N100m (left hemisphere) that occur when V (faces) are associated with A (vowel sounds) indicate that AV (face-voice) integration occurs in early processing, likely enabling us to communicate effectively in our lives.",
author = "Itta Nakamura and Yoji Hirano and Naotoshi Ohara and Shogo Hirano and Takefumi Ueno and Rikako Tsuchimoto and Shigenobu Kanba and Toshiaki Onitsuka",
year = "2015",
month = "9",
day = "1",
doi = "10.1159/000377680",
language = "English",
volume = "71",
pages = "187--195",
journal = "Neuropsychobiology",
issn = "0302-282X",
publisher = "S. Karger AG",
number = "4",

}

TY - JOUR

T1 - Early Integration Processing between Faces and Vowel Sounds in Human Brain

T2 - An MEG Investigation

AU - Nakamura, Itta

AU - Hirano, Yoji

AU - Ohara, Naotoshi

AU - Hirano, Shogo

AU - Ueno, Takefumi

AU - Tsuchimoto, Rikako

AU - Kanba, Shigenobu

AU - Onitsuka, Toshiaki

PY - 2015/9/1

Y1 - 2015/9/1

N2 - Objective: Unconscious fast integration of face and voice information is a crucial brain function necessary for communicating effectively with others. Here, we investigated for evidence of rapid face-voice integration in the auditory cortex. Methods: Magnetic fields (P50m and N100m) evoked by visual stimuli (V), auditory stimuli (A) and audiovisual stimuli (VA), i.e. by face, vowel and simultaneous vowel-face stimuli, were recorded in 22 healthy subjects. Magnetoencephalographic data from 28 channels around bilateral auditory cortices were analyzed. Results: In both hemispheres, AV - V showed significantly larger P50m amplitudes than A. Additionally, compared with A, the N100m amplitudes and dipole moments of AV - V were significantly smaller in the left hemisphere, but not in the right hemisphere. Conclusions: Differential changes in P50m (bilateral) and N100m (left hemisphere) that occur when V (faces) are associated with A (vowel sounds) indicate that AV (face-voice) integration occurs in early processing, likely enabling us to communicate effectively in our lives.

AB - Objective: Unconscious fast integration of face and voice information is a crucial brain function necessary for communicating effectively with others. Here, we investigated for evidence of rapid face-voice integration in the auditory cortex. Methods: Magnetic fields (P50m and N100m) evoked by visual stimuli (V), auditory stimuli (A) and audiovisual stimuli (VA), i.e. by face, vowel and simultaneous vowel-face stimuli, were recorded in 22 healthy subjects. Magnetoencephalographic data from 28 channels around bilateral auditory cortices were analyzed. Results: In both hemispheres, AV - V showed significantly larger P50m amplitudes than A. Additionally, compared with A, the N100m amplitudes and dipole moments of AV - V were significantly smaller in the left hemisphere, but not in the right hemisphere. Conclusions: Differential changes in P50m (bilateral) and N100m (left hemisphere) that occur when V (faces) are associated with A (vowel sounds) indicate that AV (face-voice) integration occurs in early processing, likely enabling us to communicate effectively in our lives.

UR - http://www.scopus.com/inward/record.url?scp=84930517529&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84930517529&partnerID=8YFLogxK

U2 - 10.1159/000377680

DO - 10.1159/000377680

M3 - Article

VL - 71

SP - 187

EP - 195

JO - Neuropsychobiology

JF - Neuropsychobiology

SN - 0302-282X

IS - 4

ER -