Portfolio of Original Compositions

Student thesis: Phd


This portfolio of six compositions investigates how the IoT (the Internet of Things) era's technology may augment the current interactive multimedia performance systems and interactive music composition in terms of the novel forms of machine musicianship that can emerge from machine-machine communication and artificial intelligence technology. The portfolio begins with Handwriting WuXing, which integrates ML into the existing interactive multimedia performance system, followed by Intangible Field and Audio Game - Music Force, investigating the potential of composing interactive music that involves multiple performers by applying advanced computer vision and game engine technology. Next, Sound | Figuration explores the utilisation of deep learning to enhance the composition process and new visualisation technology, which provides the opportunity to realise complex compositional concepts with a creative hybrid. Then, regarding Without strings, not only is the implementation of the IoT concept realised through machine-machine communication without active human interference, but also the real-time application of the AI-aided composition tool. Finally, Metamorphosis, as a large-scale real-time interactive audiovisual composition that presents a compelling new combination of technologies and a unique aesthetic sensibility, which virtually draws upon Bianqing percussion, further extends the concept of interaction from human-machine to machine-machine and machine-human. The thesis consists of a commentary on each piece, and supporting documentation and appendices. It includes details on each composition's initial inspiration, musical intention, compositional structure, and analysis of technology implementation.
Date of Award31 Dec 2022
Original languageEnglish
Awarding Institution
  • The University of Manchester
SupervisorRichard Whalley (Supervisor) & Ricardo Climent (Supervisor)


  • Gestural Interfaces
  • Machine learning
  • IoT
  • Artificial Intelligence
  • Multimedia performance
  • Interactive Music
  • Electroacoustic Music Composition
  • Audiovisual

Cite this