ΑΙhub.org
 

Improvising with an AI musician


by
28 October 2020



share this:
piano | AIhub

For those interested in music and AI, a session on “Human collaboration with an AI musician” at the AI for Good global summit proved to be a real treat. The session included a performance between two musicians situated on opposite sides of the globe who improvised alongside the third member of the group – an AI “musician”.

Researchers and musicians have been experimenting with machine learning algorithms for a number of years now. There has been much work devoted to recreating specific styles of music, from Bach to The Beatles and from Mozart to Mogwai. This year even saw AI-assisted song writing collide with the world of Eurovision in the AI Song Contest.

As any musician will tell you, group improvisation is perhaps the most difficult skill to master. It requires a very high level of creativity, skill, empathy and intuition. Researchers at the University of Monash and Goldsmith’s (University of London) entered into this complex world and went one step further – introducing an AI improvisor into the mix. In the video you can watch Mark d’Inverno on piano and Alon Ilsar on AirSticks (an electronic percussive instrument developed at Monash), with the AI improvisor taking the lead from Mark and its music being transmitted across the globe to Alon.

You can watch the session in full here.

As part of this session attendees also got to see four different versions of an algorithmic improvisor in action as Mark played alongside this AI “musician”. Researcher Matthew Yee-King was on hand to explain the basics of each iteration of the model. The basis for the algorithms is a variable-order Markov model.

Following the demonstrations and explanations, there was a discussion about the role of AI in music. Crucially, all involved in this project were keen to stress that they are not looking at bettering or replacing human musicians, rather they want to support and expand human creativity. The hope is that playing alongside algorithmically generated music will stimulate musicians to explore new ways of improvisation. From watching the demonstrations it was clear that this is definitely possible. It will be very interesting to see how this field of creative research develops.




Lucy Smith is Senior Managing Editor for AIhub.
Lucy Smith is Senior Managing Editor for AIhub.

            AUAI is supported by:



Subscribe to AIhub newsletter on substack



Related posts :

monthly digest

AIhub monthly digest: July 2026 – time-series anomaly detection, music generation, and RoboCup in action

  29 Jul 2026
Welcome to our monthly digest, where you can catch up with AI research, events and news from the month past.

OpenAI’s models autonomously hacked a tech startup. It signals a seismic shift in cybersecurity

  28 Jul 2026
An autonomous agent powered by OpenAI’s went rogue during a security test and hacked multi-billion dollar tech startup, Hugging Face.

Towards experiment-guided AlphaFold

Researchers enhance Nobel Prize-winning structural prediction model.

AI listens in to help protect wildlife

  24 Jul 2026
Scientists are using AI systems to help track species and spot ecosystem changes.

How can we characterize consensus in a network of agents?

  23 Jul 2026
Belief Flow Networks give a logic-based way to ask not only whether connected agents will eventually agree on a shared "belief", but which final shared beliefs can emerge.

Anyone can fake a scientific image with AI, tricking even academic journals – and undermining trust in science

  22 Jul 2026
The proliferation of AI-generated science images in public spaces is not simply a misinformation problem.

AAAI presidential panel – AI and scientific integrity

  21 Jul 2026
Watch the next panel discussion in this series from AAAI.

Congratulations to the #ICML2026 award winners

  20 Jul 2026
Find out which articles have won the outstanding paper, outstanding position paper, and the test-of-time awards.



AUAI is supported by:







Subscribe to AIhub newsletter on substack




 















©2026.05 - Association for the Understanding of Artificial Intelligence