ΑΙhub.org
 

Improvising with an AI musician


by
28 October 2020



share this:
piano | AIhub

For those interested in music and AI, a session on “Human collaboration with an AI musician” at the AI for Good global summit proved to be a real treat. The session included a performance between two musicians situated on opposite sides of the globe who improvised alongside the third member of the group – an AI “musician”.

Researchers and musicians have been experimenting with machine learning algorithms for a number of years now. There has been much work devoted to recreating specific styles of music, from Bach to The Beatles and from Mozart to Mogwai. This year even saw AI-assisted song writing collide with the world of Eurovision in the AI Song Contest.

As any musician will tell you, group improvisation is perhaps the most difficult skill to master. It requires a very high level of creativity, skill, empathy and intuition. Researchers at the University of Monash and Goldsmith’s (University of London) entered into this complex world and went one step further – introducing an AI improvisor into the mix. In the video you can watch Mark d’Inverno on piano and Alon Ilsar on AirSticks (an electronic percussive instrument developed at Monash), with the AI improvisor taking the lead from Mark and its music being transmitted across the globe to Alon.

You can watch the session in full here.

As part of this session attendees also got to see four different versions of an algorithmic improvisor in action as Mark played alongside this AI “musician”. Researcher Matthew Yee-King was on hand to explain the basics of each iteration of the model. The basis for the algorithms is a variable-order Markov model.

Following the demonstrations and explanations, there was a discussion about the role of AI in music. Crucially, all involved in this project were keen to stress that they are not looking at bettering or replacing human musicians, rather they want to support and expand human creativity. The hope is that playing alongside algorithmically generated music will stimulate musicians to explore new ways of improvisation. From watching the demonstrations it was clear that this is definitely possible. It will be very interesting to see how this field of creative research develops.




Lucy Smith is Senior Managing Editor for AIhub.
Lucy Smith is Senior Managing Editor for AIhub.




            AIhub is supported by:



Related posts :



monthly digest

AIhub monthly digest: August 2025 – causality and generative modelling, responsible multimodal AI, and IJCAI in Montréal and Guangzhou

  29 Aug 2025
Welcome to our monthly digest, where you can catch up with AI research, events and news from the month past.

Interview with Benyamin Tabarsi: Computing education and generative AI

  28 Aug 2025
Read the latest interview in our series featuring the AAAI/SIGAI Doctoral Consortium participants.

The value of prediction in identifying the worst-off: Interview with Unai Fischer Abaigar

  27 Aug 2025
We hear from the winner of an outstanding paper award at ICML2025.

#IJCAI2025 social media round-up: part two

  26 Aug 2025
Find out what the participants got up to during the main part of the conference.

AI helps chemists develop tougher plastics

  25 Aug 2025
Researchers created polymers that are more resistant to tearing by incorporating stress-responsive molecules identified by a machine learning model.

RoboCup@Work League: Interview with Christoph Steup

  22 Aug 2025
Find out more about the RoboCup League focussed on industrial production systems.

Interview with Haimin Hu: Game-theoretic integration of safety, interaction and learning for human-centered autonomy

  21 Aug 2025
Hear from Haimin in the latest in our series featuring the 2025 AAAI / ACM SIGAI Doctoral Consortium participants.

Congratulations to the #IJCAI2025 distinguished paper award winners

  20 Aug 2025
Find out who has won the prestigious awards at the International Joint Conference on Artificial Intelligence.



 

AIhub is supported by:






 












©2025.05 - Association for the Understanding of Artificial Intelligence