ΑΙhub.org
 

Improvising with an AI musician


by
28 October 2020



share this:
piano | AIhub

For those interested in music and AI, a session on “Human collaboration with an AI musician” at the AI for Good global summit proved to be a real treat. The session included a performance between two musicians situated on opposite sides of the globe who improvised alongside the third member of the group – an AI “musician”.

Researchers and musicians have been experimenting with machine learning algorithms for a number of years now. There has been much work devoted to recreating specific styles of music, from Bach to The Beatles and from Mozart to Mogwai. This year even saw AI-assisted song writing collide with the world of Eurovision in the AI Song Contest.

As any musician will tell you, group improvisation is perhaps the most difficult skill to master. It requires a very high level of creativity, skill, empathy and intuition. Researchers at the University of Monash and Goldsmith’s (University of London) entered into this complex world and went one step further – introducing an AI improvisor into the mix. In the video you can watch Mark d’Inverno on piano and Alon Ilsar on AirSticks (an electronic percussive instrument developed at Monash), with the AI improvisor taking the lead from Mark and its music being transmitted across the globe to Alon.

You can watch the session in full here.

As part of this session attendees also got to see four different versions of an algorithmic improvisor in action as Mark played alongside this AI “musician”. Researcher Matthew Yee-King was on hand to explain the basics of each iteration of the model. The basis for the algorithms is a variable-order Markov model.

Following the demonstrations and explanations, there was a discussion about the role of AI in music. Crucially, all involved in this project were keen to stress that they are not looking at bettering or replacing human musicians, rather they want to support and expand human creativity. The hope is that playing alongside algorithmically generated music will stimulate musicians to explore new ways of improvisation. From watching the demonstrations it was clear that this is definitely possible. It will be very interesting to see how this field of creative research develops.




Lucy Smith is Senior Managing Editor for AIhub.
Lucy Smith is Senior Managing Editor for AIhub.

            AUAI is supported by:



Subscribe to AIhub newsletter on substack



Related posts :

AI for Science – from cosmology to chemistry

  01 May 2026
How AI is transforming science, from a day conference at the Royal Society
monthly digest

AIhub monthly digest: April 2026 – machine learning for particle physics, AI Index Report, and table tennis

  30 Apr 2026
Welcome to our monthly digest, where you can catch up with AI research, events and news from the month past.

The Machine Ethics podcast: organoid computing with Dr Ewelina Kurtys

In this episode, Ben chats to Ewelina about the uses of organoids and energy saving computing, differences between biological neurons and digital neural networks, and much more.

#AAAI2026 invited talk: Yolanda Gil on improving workflows with AI

  28 Apr 2026
Former AAAI president on using AI to help communities of scientists better streamline their research.

Maryna Viazovska’s proofs of sphere packing formalized with AI

  27 Apr 2026
Formalization achieved through a collaboration between mathematicians and artificial intelligence tools.

Interview with Deepika Vemuri: interpretability and concept-based learning

  24 Apr 2026
Find out more about Deepika's research bridging the gap between data-driven models and symbolic learning.

As a ‘book scientist’ I work with microscopes, imaging technologies and AI to preserve ancient texts

  23 Apr 2026
Using an array of technologies to recover, understand and preserve many valuable ancient texts.

Sony AI table tennis robot outplays elite human players

  22 Apr 2026
New robot and AI system has beaten professional and elite table tennis players.



AUAI is supported by:







Subscribe to AIhub newsletter on substack




 















©2026.02 - Association for the Understanding of Artificial Intelligence