ΑΙhub.org
 

Improvising with an AI musician


by
28 October 2020



share this:
piano | AIhub

For those interested in music and AI, a session on “Human collaboration with an AI musician” at the AI for Good global summit proved to be a real treat. The session included a performance between two musicians situated on opposite sides of the globe who improvised alongside the third member of the group – an AI “musician”.

Researchers and musicians have been experimenting with machine learning algorithms for a number of years now. There has been much work devoted to recreating specific styles of music, from Bach to The Beatles and from Mozart to Mogwai. This year even saw AI-assisted song writing collide with the world of Eurovision in the AI Song Contest.

As any musician will tell you, group improvisation is perhaps the most difficult skill to master. It requires a very high level of creativity, skill, empathy and intuition. Researchers at the University of Monash and Goldsmith’s (University of London) entered into this complex world and went one step further – introducing an AI improvisor into the mix. In the video you can watch Mark d’Inverno on piano and Alon Ilsar on AirSticks (an electronic percussive instrument developed at Monash), with the AI improvisor taking the lead from Mark and its music being transmitted across the globe to Alon.

You can watch the session in full here.

As part of this session attendees also got to see four different versions of an algorithmic improvisor in action as Mark played alongside this AI “musician”. Researcher Matthew Yee-King was on hand to explain the basics of each iteration of the model. The basis for the algorithms is a variable-order Markov model.

Following the demonstrations and explanations, there was a discussion about the role of AI in music. Crucially, all involved in this project were keen to stress that they are not looking at bettering or replacing human musicians, rather they want to support and expand human creativity. The hope is that playing alongside algorithmically generated music will stimulate musicians to explore new ways of improvisation. From watching the demonstrations it was clear that this is definitely possible. It will be very interesting to see how this field of creative research develops.




Lucy Smith is Senior Managing Editor for AIhub.
Lucy Smith is Senior Managing Editor for AIhub.

            AIhub is supported by:



Subscribe to AIhub newsletter on substack



Related posts :

Scaling up multi-agent systems: an interview with Minghong Geng

  07 Apr 2026
We sat down with Minghong in the latest of our interviews with the 2026 AAAI/SIGAI Doctoral Consortium participants.

Forthcoming machine learning and AI seminars: April 2026 edition

  02 Apr 2026
A list of free-to-attend AI-related seminars that are scheduled to take place between 2 April and 31 May 2026.

#AAAI2026 invited talk: machine learning for particle physics

  01 Apr 2026
How is ML used in the search for new particles at CERN?
monthly digest

AIhub monthly digest: March 2026 – time series, multiplicity, and the history of RoboCup

  31 Mar 2026
Welcome to our monthly digest, where you can catch up with AI research, events and news from the month past.

What I’ve learned from 25 years of automated science, and what the future holds: an interview with Ross King

  30 Mar 2026
We launch our new series with a conversation with Ross King - a pioneer in the field of AI-enabled scientific discovery.

A multi-armed robot for assisting with agricultural tasks

and   27 Mar 2026
How can a robot safely manipulate branches to reveal hidden flowers while remaining aware of interaction forces and minimizing damage?

Resource-constrained image generation and visual understanding: an interview with Aniket Roy

  26 Mar 2026
Aniket tells us about his research exploring how modern generative models can be adapted to operate efficiently while maintaining strong performance.

RWDS Big Questions: how do we highlight the role of statistics in AI?

  25 Mar 2026
Next in our series, the panel explores the statistical underpinning of AI.



AIhub is supported by:







Subscribe to AIhub newsletter on substack




 















©2026.02 - Association for the Understanding of Artificial Intelligence