Birds on paper: An alternative interface to compose music by utilizing sketch drawing and mobile device

Chen Wei Chiang, Shu Chuan Chiu, Anak Agung Gede Dharma, Kiyoshi Tomimatsu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

7 Citations (Scopus)

Abstract

In this paper we describes a new concept of utilizing a mobile device or Personal Digital Assistant (PDA) for musical composition. We design a new interface that combines the ease of use of a pencil and the portability and customizability of mobile device. Our proposed kit involves the affordances provided by paper computing in order to provide user experiences to novice users. By effectively using the principle of electrical conductivity and signal processing, we have developed a functional prototype ("Birds on Paper") that enables users to compose their own music. Our proposed kit consists of 4 main elements, i.e.: pencil, birds-shaped sensor, hub connector, and mobile device or PDA. Pencil can be applied on a piece of paper as the main medium to visualize the musical composition. Touching the graphite surface of the drawing will trigger an audio feedback in the form of musical notes. Musical notes will be generated based on the thickness and the length of the pencil drawings, thus enables users to intuitively compose the music according to their preference. In addition to the description of the kit, we also discuss the concept behind the design and possible user scenarios.

Original languageEnglish
Title of host publicationProceedings of the 6th International Conference on Tangible, Embedded and Embodied Interaction, TEI 2012
Pages201-204
Number of pages4
DOIs
Publication statusPublished - Apr 2 2012
Event6th International Conference on Tangible, Embedded and Embodied Interaction, TEI 2012 - Kingston, ON, Canada
Duration: Feb 19 2012Feb 22 2012

Publication series

NameProceedings of the 6th International Conference on Tangible, Embedded and Embodied Interaction, TEI 2012

Other

Other6th International Conference on Tangible, Embedded and Embodied Interaction, TEI 2012
CountryCanada
CityKingston, ON
Period2/19/122/22/12

Fingerprint

Birds
Mobile devices
Personal digital assistants
Chemical analysis
Signal processing
Graphite
Feedback
Sensors

All Science Journal Classification (ASJC) codes

  • Human-Computer Interaction

Cite this

Chiang, C. W., Chiu, S. C., Dharma, A. A. G., & Tomimatsu, K. (2012). Birds on paper: An alternative interface to compose music by utilizing sketch drawing and mobile device. In Proceedings of the 6th International Conference on Tangible, Embedded and Embodied Interaction, TEI 2012 (pp. 201-204). (Proceedings of the 6th International Conference on Tangible, Embedded and Embodied Interaction, TEI 2012). https://doi.org/10.1145/2148131.2148175

Birds on paper : An alternative interface to compose music by utilizing sketch drawing and mobile device. / Chiang, Chen Wei; Chiu, Shu Chuan; Dharma, Anak Agung Gede; Tomimatsu, Kiyoshi.

Proceedings of the 6th International Conference on Tangible, Embedded and Embodied Interaction, TEI 2012. 2012. p. 201-204 (Proceedings of the 6th International Conference on Tangible, Embedded and Embodied Interaction, TEI 2012).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Chiang, CW, Chiu, SC, Dharma, AAG & Tomimatsu, K 2012, Birds on paper: An alternative interface to compose music by utilizing sketch drawing and mobile device. in Proceedings of the 6th International Conference on Tangible, Embedded and Embodied Interaction, TEI 2012. Proceedings of the 6th International Conference on Tangible, Embedded and Embodied Interaction, TEI 2012, pp. 201-204, 6th International Conference on Tangible, Embedded and Embodied Interaction, TEI 2012, Kingston, ON, Canada, 2/19/12. https://doi.org/10.1145/2148131.2148175
Chiang CW, Chiu SC, Dharma AAG, Tomimatsu K. Birds on paper: An alternative interface to compose music by utilizing sketch drawing and mobile device. In Proceedings of the 6th International Conference on Tangible, Embedded and Embodied Interaction, TEI 2012. 2012. p. 201-204. (Proceedings of the 6th International Conference on Tangible, Embedded and Embodied Interaction, TEI 2012). https://doi.org/10.1145/2148131.2148175
Chiang, Chen Wei ; Chiu, Shu Chuan ; Dharma, Anak Agung Gede ; Tomimatsu, Kiyoshi. / Birds on paper : An alternative interface to compose music by utilizing sketch drawing and mobile device. Proceedings of the 6th International Conference on Tangible, Embedded and Embodied Interaction, TEI 2012. 2012. pp. 201-204 (Proceedings of the 6th International Conference on Tangible, Embedded and Embodied Interaction, TEI 2012).
@inproceedings{578f2e9aecdb4483a42f3363e447f92b,
title = "Birds on paper: An alternative interface to compose music by utilizing sketch drawing and mobile device",
abstract = "In this paper we describes a new concept of utilizing a mobile device or Personal Digital Assistant (PDA) for musical composition. We design a new interface that combines the ease of use of a pencil and the portability and customizability of mobile device. Our proposed kit involves the affordances provided by paper computing in order to provide user experiences to novice users. By effectively using the principle of electrical conductivity and signal processing, we have developed a functional prototype ({"}Birds on Paper{"}) that enables users to compose their own music. Our proposed kit consists of 4 main elements, i.e.: pencil, birds-shaped sensor, hub connector, and mobile device or PDA. Pencil can be applied on a piece of paper as the main medium to visualize the musical composition. Touching the graphite surface of the drawing will trigger an audio feedback in the form of musical notes. Musical notes will be generated based on the thickness and the length of the pencil drawings, thus enables users to intuitively compose the music according to their preference. In addition to the description of the kit, we also discuss the concept behind the design and possible user scenarios.",
author = "Chiang, {Chen Wei} and Chiu, {Shu Chuan} and Dharma, {Anak Agung Gede} and Kiyoshi Tomimatsu",
year = "2012",
month = "4",
day = "2",
doi = "10.1145/2148131.2148175",
language = "English",
isbn = "9781450311748",
series = "Proceedings of the 6th International Conference on Tangible, Embedded and Embodied Interaction, TEI 2012",
pages = "201--204",
booktitle = "Proceedings of the 6th International Conference on Tangible, Embedded and Embodied Interaction, TEI 2012",

}

TY - GEN

T1 - Birds on paper

T2 - An alternative interface to compose music by utilizing sketch drawing and mobile device

AU - Chiang, Chen Wei

AU - Chiu, Shu Chuan

AU - Dharma, Anak Agung Gede

AU - Tomimatsu, Kiyoshi

PY - 2012/4/2

Y1 - 2012/4/2

N2 - In this paper we describes a new concept of utilizing a mobile device or Personal Digital Assistant (PDA) for musical composition. We design a new interface that combines the ease of use of a pencil and the portability and customizability of mobile device. Our proposed kit involves the affordances provided by paper computing in order to provide user experiences to novice users. By effectively using the principle of electrical conductivity and signal processing, we have developed a functional prototype ("Birds on Paper") that enables users to compose their own music. Our proposed kit consists of 4 main elements, i.e.: pencil, birds-shaped sensor, hub connector, and mobile device or PDA. Pencil can be applied on a piece of paper as the main medium to visualize the musical composition. Touching the graphite surface of the drawing will trigger an audio feedback in the form of musical notes. Musical notes will be generated based on the thickness and the length of the pencil drawings, thus enables users to intuitively compose the music according to their preference. In addition to the description of the kit, we also discuss the concept behind the design and possible user scenarios.

AB - In this paper we describes a new concept of utilizing a mobile device or Personal Digital Assistant (PDA) for musical composition. We design a new interface that combines the ease of use of a pencil and the portability and customizability of mobile device. Our proposed kit involves the affordances provided by paper computing in order to provide user experiences to novice users. By effectively using the principle of electrical conductivity and signal processing, we have developed a functional prototype ("Birds on Paper") that enables users to compose their own music. Our proposed kit consists of 4 main elements, i.e.: pencil, birds-shaped sensor, hub connector, and mobile device or PDA. Pencil can be applied on a piece of paper as the main medium to visualize the musical composition. Touching the graphite surface of the drawing will trigger an audio feedback in the form of musical notes. Musical notes will be generated based on the thickness and the length of the pencil drawings, thus enables users to intuitively compose the music according to their preference. In addition to the description of the kit, we also discuss the concept behind the design and possible user scenarios.

UR - http://www.scopus.com/inward/record.url?scp=84859035247&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84859035247&partnerID=8YFLogxK

U2 - 10.1145/2148131.2148175

DO - 10.1145/2148131.2148175

M3 - Conference contribution

AN - SCOPUS:84859035247

SN - 9781450311748

T3 - Proceedings of the 6th International Conference on Tangible, Embedded and Embodied Interaction, TEI 2012

SP - 201

EP - 204

BT - Proceedings of the 6th International Conference on Tangible, Embedded and Embodied Interaction, TEI 2012

ER -