Formal congruency between Telop patterns and sound effects

Ki Hong Kim, Shin Ichiro Iwamiya

    Research output: Contribution to journalArticlepeer-review

    11 Citations (Scopus)


    The effects of formal congruency between Telops (animated text on a display) and sound effects on the affect of audio-visual content were investigated. Rating experiments were performed using systematic combinations of various Telops and sound patterns. As a result, formal congruency contributed to enhancing subjective congruency between Telop and sound patterns. Formal congruency also contributed to enhancing the evaluation of audio-visual productions. Two types of formal congruency were effective in creating subjective congruency: the synchronization of temporal structures and the matching of changing patterns between auditory and visual events. To create formal congruency based on synchronization between auditory and visual structures, correspondence of the onsets of sound and Telop was important. The combinations of the gradually rising loudness or pitch of sounds and the expanding (or approaching) of Telop pattern were found to create the matching of changing patterns.

    Original languageEnglish
    Pages (from-to)429-448
    Number of pages20
    JournalMusic Perception
    Issue number5
    Publication statusPublished - Jun 1 2008

    All Science Journal Classification (ASJC) codes

    • Music


    Dive into the research topics of 'Formal congruency between Telop patterns and sound effects'. Together they form a unique fingerprint.

    Cite this