ΑΙhub.org
 

Using AI-enhanced music-supported therapy to assist stroke patients


by
26 January 2021



share this:

music therapy set-up
Stroke currently ranks as the second most common cause of death and the second most common cause of disability worldwide. Motor deficits of the upper extremity (hemiparesis) are the most common and debilitating consequences of stroke, affecting around 80% of patients. These deficits limit the accomplishment of daily activities, affect social participation, are the origin of significant emotional distress, and cause profound detrimental effects on quality of life.

AIhub focus issue on good health and well-being

Stroke rehabilitation aims to improve and maintain functional ability through restitution, substitution and compensation of functions. The restoration of motor deficits and improvements in motor function typically occurs during the first months following a stroke and therefore, major efforts are devoted to this acute stage. Despite the recommendations for maintaining an active lifestyle, stroke survivors show low levels of activity and they may even experience functional deterioration during the chronic phase. However, numerous studies have found that functionality can be improved with training in chronic stroke patients. In this context, there has been an increasing interest in the rehabilitative potential of music. Music-based therapies have a multisensory nature that fits with rehabilitation principles, they seem enjoyable for patients, and are feasible to apply. One of the most-investigated music-based therapies is music-supported therapy (MST), where patients are trained to play musical instruments to enhance the motor function of the upper extremity.

The goal of the Play&Sing project is to take a step further in MST interventions by developing an AI platform, HMST, to allow home-based MST using previous experience in hospital-based MST interventions to induce upper limb motor recovery.

With HMST, patients perform rhythmic exercises with percussion instruments and play some musical sequences with a keyboard connected to a tablet-based application. HMST increases motivation and patients’ active participation via self-regulated music training at home by incorporating (1) a continuous monitoring of patient activities; (2) prediction and prescription algorithms to personalize exercises, adjusting their difficulty to the patient’s progress and needs; (3) positive feedback and gamification strategies as a mechanism to enhance patient adherence and learning.

The role of the prediction component is to continuously determine the effect of the intervention. To assess such effect, additionally to the patient profile generated from different motor and cognitive tests, three different indicators are exploited to assess the performance of a patient during the training sessions: the execution speed, the key pressure, and the errors.

music training therapy research - graphs

After each patient session, the prediction component, by combining case-based reasoning (CBR) and regression techniques, revises the prediction by incorporating the performance information of the last session.

The role of the prescription component is to propose to each patient the most pertinent activities combining the therapeutic goals prioritized by therapists and the preferences of the patient. The task is modelled as an optimization problem where multiple activities (melodic sequences played with a specific fingering pattern) have to be distributed along several training sessions trying to maximize the value of the intervention, where the value depends on the estimated contribution of each activity. The contribution of each activity is continuously estimated from the analysis of patient performance, the therapeutic goals, the preferences, and the accumulated experience from other patients using the platform.

The prescription component exploits two sources of information: intra-patient information and inter-patient information. The first step is to select a subset of appropriate exercises, i.e. exercises estimated as feasible and not too trivial (e.g. which have been easily overcome previously). This selection is performed by using a CBR system that, measuring clinical and performance similarities, ranks activities according to past experience. The second step is to weigh each activity according to its effectiveness, and intervention values within similar patients. Next, activity weights are refined according to patient preferences and therapist goals. Finally, the list of activities, their associated weights, and intervention constraints (such as the maximum number or repetitions per activity) are sent to the optimiser.

You can find out more about the project here.



tags: ,


Josep Lluís Arcos is a Research Scientist at the Artificial Intelligence Research Institute of the Spanish National Research Council
Josep Lluís Arcos is a Research Scientist at the Artificial Intelligence Research Institute of the Spanish National Research Council




            AIhub is supported by:


Related posts :



Exploring counterfactuals in continuous-action reinforcement learning

  20 Jun 2025
Shuyang Dong writes about her work that will be presented at IJCAI 2025.

What is vibe coding? A computer scientist explains what it means to have AI write computer code − and what risks that can entail

  19 Jun 2025
Until recently, most computer code was written, at least originally, by human beings. But with the advent of GenAI, that has begun to change.

Gearing up for RoboCupJunior: Interview with Ana Patrícia Magalhães

  18 Jun 2025
We hear from the organiser of RoboCupJunior 2025 and find out how the preparations are going for the event.

Interview with Mahammed Kamruzzaman: Understanding and mitigating biases in large language models

  17 Jun 2025
Find out how Mahammed is investigating multiple facets of biases in LLMs.

Google’s SynthID is the latest tool for catching AI-made content. What is AI ‘watermarking’ and does it work?

  16 Jun 2025
Last month, Google announced SynthID Detector, a new tool to detect AI-generated content.

The Good Robot podcast: Symbiosis from bacteria to AI with N. Katherine Hayles

  13 Jun 2025
In this episode, Eleanor and Kerry talk to N. Katherine Hayles about her new book, and discuss how the biological concept of symbiosis can inform the relationships we have with AI.

Preparing for kick-off at RoboCup2025: an interview with General Chair Marco Simões

  12 Jun 2025
We caught up with Marco to find out what exciting events are in store at this year's RoboCup.

Graphic novel explains the environmental impact of AI

  11 Jun 2025
EPFL’s Center for Learning Sciences has released Utop’IA, an educational graphic novel that explores the environmental impact of artificial intelligence.



 

AIhub is supported by:






©2025.05 - Association for the Understanding of Artificial Intelligence


 












©2025.05 - Association for the Understanding of Artificial Intelligence