GePS - Gesture-based Performance System

USING A DATA GLOVE AS MUSICAL INSTRUMENT

Research

Gestural control in electronic music performance: sound design based on the ‘striking’ and ‘bowing’ movement metaphors

Frederic Robinson, Cedric Spindler, Volker Böhm, Erik Oña

Abstract

Following a call for clear movement-sound relationships in motion-controlled digital musical instruments (DMIs), we developed a sound design concept and a DMI implementation with a focus on transparency through intuitive control metaphors. In order to benefit from the listener’s and performer’s natural understanding of physical processes around them, we use gestures with strong physical associations as control metaphors, which are then mapped to sound modules specifically designed to represent these associations sonically. The required motion data can be captured by any low-latency sensor device worn on the hand or wrist, that has an inertial measurement unit with six degrees of freedom. A dimension space analysis was applied on the current implementation in order to compare it to existing DMIs and illustrate its characteristics. In conclusion, our approach resulted in a DMI with strong results in transparency, intuitive control metaphors, and a coherent audio-visual link.

Download

Preprint PDF
Online proceedings of Audio Mostly 2015, at ACM Digital Library

Cite

MLA

Robinson, Frederic, et al. "Gestural control in electronic music performance: sound design based on the 'striking' and 'bowing' movement metaphors." Proceedings of the Audio Mostly 2015 on Interaction With Sound. ACM, 2015.

APA

Robinson, F., Spindler, C., Böhm, V., & Oña, E. (2015, October). Gestural control in electronic music performance: sound design based on the 'striking' and 'bowing' movement metaphors. In Proceedings of the Audio Mostly 2015 on Interaction With Sound (p. 26). ACM.

BibTeX (download)

@inproceedings{robinson2015gestural,
	Title = {Gestural Control in Electronic Music Performance: Sound Design Based on the `Striking' and `Bowing' Movement Metaphors},
	Author = {Robinson, Frederic and Spindler, Cedric and B{\"o}hm, Volker and O{\~n}a, Erik},
	Booktitle = {Proceedings of the Audio Mostly 2015 on Interaction With Sound},
	Year = {2015},
	Location = {Thessaloniki, Greece},
	Series = {AM '15},
	Articleno = {26},
	Pages = {26:1--26:6},
	Numpages = {6},
	Keywords = {DMI., Gestural control, musical interface},
	Publisher = {ACM},
	Acmid = {2814901},
	Doi = {10.1145/2814895.2814901},
	Isbn = {978-1-4503-3896-7}}