»Noh •○ Virtual«- for Beatboxer and Digital Twin (2022)

Ricardo Climent (Composer)

Research output: Non-textual formComposition

Abstract

"Noh • Virtual" is a live interactive music performance and project by Ricardo Climent, at the intersections of Artificial Intelligence and Creativity with a focus on the exploration of perceived time in composition and performance. The piece employs several machine learning models (IRCAM's RAVE and SampleRNN) trained on a very large collection of vocal samples and body gesture from Greek singer and beatboxer champion Giorgos Gargalas (voice). The stage performance portrays a Human-Machine musical extravaganza which further explores Climent's works focused on musical battles (duel of strings, bass clarinets, VCS3 synths, saxophones duels) informed by historical duels (Mozart vs. Clementi, in 1781; Stiebelt vs. Beethoven, in 1800). However, "Noh • Virtual" embraces a more collaborative, rather than competitive, musical spirit creating meaningful dialogues between the human voice and its 'virtual AI twin'.

Stage performance and musical interactivity are designed to explore methods found in theatre performance including aspects of materiality emerging vocality, corporality, spatiality and tonality (Fischer-Lichte, 2008). The research on the perception of time implements Climent's findings on Japanese Noh theatre during his field work across Japan (Sep 2019 - Jan 2020) following the fingerprints and plays of Noh theatre playwriter pioneer and actor Zeami Motokiyo’s (ca. 1363 –1443, 世阿弥 元清). Noh performances are characterised by its very slow pace and minimal stage action which highly clash with the aesthetics of Beatboxing culture. The piece juxtaposes the Noh masks and the ritual of slowness to become a portal for audiences to enter the character’s life and emotions of the AI and transcend the perception of the Self. The piece structure navigates four stages, ranging from ancient Japan, to modern Japan, as a framework for the exploration of trans-culturalism and the use of vocal taxonomies in the musical duet.

"Noh • Virtual" is a collaborative project funded by the Faculty Research Recovery Fund (post Covid) with Gargalas, Fan (AI and Motion Capture) and Mesarosova/Ferrer (3D modelling. Its spin-off output entitled 'A.I. Beatboxer' was premiered at the Manchester Science Festival in 2022 as an interactive installation and it was experienced by ca. 22.000 attendees.


Original languageEnglish
Place of Publicationhttps://www.unsupervised.uk/watch/unsupervised2
PublisherUnSupervised.uk
EditionUnSupervised#2
Publication statusPublished - 27 Jun 2022

Fingerprint

Dive into the research topics of '»Noh •○ Virtual«- for Beatboxer and Digital Twin (2022)'. Together they form a unique fingerprint.

Cite this