Musical instrument mapping design with Echo State Network

Kiefer, Chris (2014) Musical instrument mapping design with Echo State Network. New Interaces for Musical Expression, Goldsmiths, London, June 2014. Published in: Proceedings of the International Conference on New Interfaces for Musical Expression. 293-298. ISSN 2220-4806

[img] PDF - Published Version
Available under License All Rights Reserved.

Download (1MB)


Echo State Networks (ESNs), a form of recurrent neural network developed in the field of Reservoir Computing, show significant potential for use as a tool in the design of mappings for digital musical instruments. They have, however, seldom been used in this area, so this paper explores their possible uses. This project contributes a new open source library, which was developed to allow ESNs to run in the Pure Data dataflow environment. Several use cases were explored, focusing on addressing current issues in mapping research. ESNs were found to work successfully in scenarios of pattern classification, multiparametric control, explorative mapping and the design of nonlinearities and uncontrol. \emph{Un-trained} behaviours are proposed, as augmentations to the conventional reservoir system that allow the player to introduce potentially interesting non-linearities and uncontrol into the reservoir. Interactive evolution style controls are proposed as strategies to help design these behaviours, which are otherwise dependent on arbitrary parameters. A study on sound classification shows that ESNs can reliably differentiate between two drum sounds, and also generalise to other similar input. Following evaluation of the use cases, heuristics are proposed to aid the use of ESNs in computer music scenarios.

Item Type: Conference Proceedings
Keywords: machine learning, mapping, instrument design, dynamical systems, uncontrol
Schools and Departments: School of Media, Film and Music > Music
Research Centres and Groups: Centre for Research in Creative and Performing Arts
Subjects: M Music. Literature on music. Musical instruction and study > M Music
Q Science > Q Science (General) > Q0300 Cybernetics
Q Science > QA Mathematics > QA0075 Electronic computers. Computer science
Related URLs:
Depositing User: Chris Kiefer
Date Deposited: 07 Sep 2018 14:59
Last Modified: 07 Sep 2018 14:59

View download statistics for this item

📧 Request an update