Nervixxx: A video performance system with neural interfaces

Nervixxx introduces neural computing to overcome the limit of conventional performance systems ¹ that uses tangible computing and physical computing. Specifically, we utilized the EEG (electroencephalogram) which is the most informative of the biosignals, and the EMG (electromyogram) which has a high controllability. Users manipulate the tangible objects that are the major function of this system. This intuitively enables to mix and apply visual effects as a motion graphics data. At the same time, users can control the playing speed and the parameter for each effect by wearing wireless EMG sensors on each of their arms. Also, users' brain waves can be used in real-time as a motion graphics data by wearing an EEG sensor. By introducing neural computing to tangible computing, it not only realizes the intuitive manipulation of applications but also increases the attractiveness of the actual performance. Moreover, the individuality of each user is reflected in the performer's ability to express him or herself.