Formal congruency between Telop patterns and sound effects

Ki Hong Kim, Shin Ichiro Iwamiya

Research output: Contribution to journalArticlepeer-review

9 Citations (Scopus)

Abstract

The effects of formal congruency between Telops (animated text on a display) and sound effects on the affect of audio-visual content were investigated. Rating experiments were performed using systematic combinations of various Telops and sound patterns. As a result, formal congruency contributed to enhancing subjective congruency between Telop and sound patterns. Formal congruency also contributed to enhancing the evaluation of audio-visual productions. Two types of formal congruency were effective in creating subjective congruency: the synchronization of temporal structures and the matching of changing patterns between auditory and visual events. To create formal congruency based on synchronization between auditory and visual structures, correspondence of the onsets of sound and Telop was important. The combinations of the gradually rising loudness or pitch of sounds and the expanding (or approaching) of Telop pattern were found to create the matching of changing patterns.

Original languageEnglish
Pages (from-to)429-448
Number of pages20
JournalMusic Perception
Volume25
Issue number5
DOIs
Publication statusPublished - Jun 1 2008

All Science Journal Classification (ASJC) codes

  • Music

Fingerprint Dive into the research topics of 'Formal congruency between Telop patterns and sound effects'. Together they form a unique fingerprint.

Cite this