Birds on paper: An alternative interface to compose music by utilizing sketch drawing and mobile device

Chen Wei Chiang, Shu Chuan Chiu, Anak Agung Gede Dharma, Kiyoshi Tomimatsu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

7 Citations (Scopus)

Abstract

In this paper we describes a new concept of utilizing a mobile device or Personal Digital Assistant (PDA) for musical composition. We design a new interface that combines the ease of use of a pencil and the portability and customizability of mobile device. Our proposed kit involves the affordances provided by paper computing in order to provide user experiences to novice users. By effectively using the principle of electrical conductivity and signal processing, we have developed a functional prototype ("Birds on Paper") that enables users to compose their own music. Our proposed kit consists of 4 main elements, i.e.: pencil, birds-shaped sensor, hub connector, and mobile device or PDA. Pencil can be applied on a piece of paper as the main medium to visualize the musical composition. Touching the graphite surface of the drawing will trigger an audio feedback in the form of musical notes. Musical notes will be generated based on the thickness and the length of the pencil drawings, thus enables users to intuitively compose the music according to their preference. In addition to the description of the kit, we also discuss the concept behind the design and possible user scenarios.

Original languageEnglish
Title of host publicationProceedings of the 6th International Conference on Tangible, Embedded and Embodied Interaction, TEI 2012
Pages201-204
Number of pages4
DOIs
Publication statusPublished - Apr 2 2012
Event6th International Conference on Tangible, Embedded and Embodied Interaction, TEI 2012 - Kingston, ON, Canada
Duration: Feb 19 2012Feb 22 2012

Publication series

NameProceedings of the 6th International Conference on Tangible, Embedded and Embodied Interaction, TEI 2012

Other

Other6th International Conference on Tangible, Embedded and Embodied Interaction, TEI 2012
CountryCanada
CityKingston, ON
Period2/19/122/22/12

    Fingerprint

All Science Journal Classification (ASJC) codes

  • Human-Computer Interaction

Cite this

Chiang, C. W., Chiu, S. C., Dharma, A. A. G., & Tomimatsu, K. (2012). Birds on paper: An alternative interface to compose music by utilizing sketch drawing and mobile device. In Proceedings of the 6th International Conference on Tangible, Embedded and Embodied Interaction, TEI 2012 (pp. 201-204). (Proceedings of the 6th International Conference on Tangible, Embedded and Embodied Interaction, TEI 2012). https://doi.org/10.1145/2148131.2148175