Classifying Biometric Data for Musical Interaction within Virtual Reality

Research output: Chapter in Book/Report/Conference proceedingChapterpeer-review

256 Downloads (Pure)

Abstract

Since 2015, commercial gestural interfaces have widened accessibility for researchers and artists to use novel Electromyographic (EMG) biometric data. EMG data measures musclar amplitude and allows us to enhance Human-Computer Interaction (HCI) through providing natural gestural interaction with digital media. Virtual Reality (VR) is an immersive technology capable of simulating the real world and abstractions of it. However, current commercial VR technology is not equipped to process and use biometric information. Using biometrics within VR allows for better gestural detailing and use of complex custom gestures, such as those found within instrumental music performance, compared to using optical sensors for gesture recognition in current commercial VR equipment. However, EMG data is complex and machine learning must be used to employ it. This study uses a Myo armband to classify four custom gestures in Wekinator and observe their prediction accuracies and representations (including or omitting signal onset) to compose music within VR. Results show that specific regression and classification models, according to gesture representation type, are the most accurate when classifying four music gestures for advanced music HCI in VR. We apply and record our results, showing that EMG biometrics are promising for future interactive music composition systems in VR.
Original languageEnglish
Title of host publication11th International Conference on Artificial Intelligence in Music, Sound, Art and Design (EvoMUSART) 2022
PublisherSpringer Nature
DOIs
Publication statusPublished - 15 Apr 2022

Publication series

NameLecture Notes in Computer Science
PublisherSpringer Nature

Fingerprint

Dive into the research topics of 'Classifying Biometric Data for Musical Interaction within Virtual Reality'. Together they form a unique fingerprint.

Cite this