onNote: Playing printed music scores as a musical instrument

Yusuke Yamamoto, Hideaki Uchiyama, Yasuaki Kakehi

研究成果: 著書/レポートタイプへの貢献会議での発言

3 引用 (Scopus)

抄録

This paper presents a novel musical performance system named onNote that directly utilizes printed music scores as a musical instrument. This system can make users believe that sound is indeed embedded on the music notes in the scores. The users can play music simply by placing, moving and touching the scores under a desk lamp equipped with a camera and a small projector. By varying the movement, the users can control the playing sound and the tempo of the music. To develop this system, we propose an image processing based framework for retrieving music from a music database by capturing printed music scores. From a captured image, we identify the scores by matching them with the reference music scores, and compute the position and pose of the scores with respect to the camera. By using this framework, we can develop novel types of musical interactions.

元の言語英語
ホスト出版物のタイトルUIST'11 - Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology
ページ413-422
ページ数10
DOI
出版物ステータス出版済み - 11 14 2011
イベント24th Annual ACM Symposium on User Interface Software and Technology, UIST'11 - Santa Barbara, CA, 米国
継続期間: 10 16 201110 19 2011

出版物シリーズ

名前UIST'11 - Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology

その他

その他24th Annual ACM Symposium on User Interface Software and Technology, UIST'11
米国
Santa Barbara, CA
期間10/16/1110/19/11

Fingerprint

Musical instruments
Cameras
Acoustic waves
Electric lamps
Image processing

All Science Journal Classification (ASJC) codes

  • Human-Computer Interaction
  • Software

これを引用

Yamamoto, Y., Uchiyama, H., & Kakehi, Y. (2011). onNote: Playing printed music scores as a musical instrument. : UIST'11 - Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (pp. 413-422). (UIST'11 - Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology). https://doi.org/10.1145/2047196.2047249

onNote : Playing printed music scores as a musical instrument. / Yamamoto, Yusuke; Uchiyama, Hideaki; Kakehi, Yasuaki.

UIST'11 - Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology. 2011. p. 413-422 (UIST'11 - Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology).

研究成果: 著書/レポートタイプへの貢献会議での発言

Yamamoto, Y, Uchiyama, H & Kakehi, Y 2011, onNote: Playing printed music scores as a musical instrument. : UIST'11 - Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology. UIST'11 - Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology, pp. 413-422, 24th Annual ACM Symposium on User Interface Software and Technology, UIST'11, Santa Barbara, CA, 米国, 10/16/11. https://doi.org/10.1145/2047196.2047249
Yamamoto Y, Uchiyama H, Kakehi Y. onNote: Playing printed music scores as a musical instrument. : UIST'11 - Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology. 2011. p. 413-422. (UIST'11 - Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology). https://doi.org/10.1145/2047196.2047249
Yamamoto, Yusuke ; Uchiyama, Hideaki ; Kakehi, Yasuaki. / onNote : Playing printed music scores as a musical instrument. UIST'11 - Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology. 2011. pp. 413-422 (UIST'11 - Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology).
@inproceedings{3d58f9bba8a14c2bb61b04a1f76a1833,
title = "onNote: Playing printed music scores as a musical instrument",
abstract = "This paper presents a novel musical performance system named onNote that directly utilizes printed music scores as a musical instrument. This system can make users believe that sound is indeed embedded on the music notes in the scores. The users can play music simply by placing, moving and touching the scores under a desk lamp equipped with a camera and a small projector. By varying the movement, the users can control the playing sound and the tempo of the music. To develop this system, we propose an image processing based framework for retrieving music from a music database by capturing printed music scores. From a captured image, we identify the scores by matching them with the reference music scores, and compute the position and pose of the scores with respect to the camera. By using this framework, we can develop novel types of musical interactions.",
author = "Yusuke Yamamoto and Hideaki Uchiyama and Yasuaki Kakehi",
year = "2011",
month = "11",
day = "14",
doi = "10.1145/2047196.2047249",
language = "English",
isbn = "9781450307161",
series = "UIST'11 - Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology",
pages = "413--422",
booktitle = "UIST'11 - Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology",

}

TY - GEN

T1 - onNote

T2 - Playing printed music scores as a musical instrument

AU - Yamamoto, Yusuke

AU - Uchiyama, Hideaki

AU - Kakehi, Yasuaki

PY - 2011/11/14

Y1 - 2011/11/14

N2 - This paper presents a novel musical performance system named onNote that directly utilizes printed music scores as a musical instrument. This system can make users believe that sound is indeed embedded on the music notes in the scores. The users can play music simply by placing, moving and touching the scores under a desk lamp equipped with a camera and a small projector. By varying the movement, the users can control the playing sound and the tempo of the music. To develop this system, we propose an image processing based framework for retrieving music from a music database by capturing printed music scores. From a captured image, we identify the scores by matching them with the reference music scores, and compute the position and pose of the scores with respect to the camera. By using this framework, we can develop novel types of musical interactions.

AB - This paper presents a novel musical performance system named onNote that directly utilizes printed music scores as a musical instrument. This system can make users believe that sound is indeed embedded on the music notes in the scores. The users can play music simply by placing, moving and touching the scores under a desk lamp equipped with a camera and a small projector. By varying the movement, the users can control the playing sound and the tempo of the music. To develop this system, we propose an image processing based framework for retrieving music from a music database by capturing printed music scores. From a captured image, we identify the scores by matching them with the reference music scores, and compute the position and pose of the scores with respect to the camera. By using this framework, we can develop novel types of musical interactions.

UR - http://www.scopus.com/inward/record.url?scp=80755168345&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=80755168345&partnerID=8YFLogxK

U2 - 10.1145/2047196.2047249

DO - 10.1145/2047196.2047249

M3 - Conference contribution

AN - SCOPUS:80755168345

SN - 9781450307161

T3 - UIST'11 - Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology

SP - 413

EP - 422

BT - UIST'11 - Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology

ER -