ΑΙhub.org
 

Decoding brain activity into speech


by
01 May 2019



share this:


A recent paper in Nature reports on a new technology created by UC San Francisco neuroscientists that translates neural activity into speech. Although the technology was trialled on participants with intact speech, the hope is that it could be transformative in the future for people who are unable to communicate as a result of neurological impairments.

The researchers asked five volunteers being treated at the UCSF Epilepsy Center, with electrodes temporarily implanted in their brains, to read several hundred sentences aloud while their brain activity was recorded.

Based on the audio recordings of participants’ voices, the researchers used linguistic principles to reverse engineer the vocal tract movements needed to produce those sounds: pressing the lips together, tightening vocal cords, shifting the tip of the tongue to the roof of the mouth, then relaxing it, and so on.

This detailed mapping of sound to anatomy allowed the scientists to create a realistic virtual vocal tract for each participant that could be controlled by their brain activity. This included two neural networks: a decoder that transforms brain activity patterns produced during speech into movements of the virtual vocal tract, and a synthesizer that converts these vocal tract movements into a synthetic approximation of the participant’s voice.

A video of the resulting brain-to-speech synthesis can be found below.

You can read the UC San Francisco press release on which this news highlight is based here.

Reference
Anumanchipalli, G. K., Chartier, J., & Chang, E. F. (2019). Speech synthesis from neural decoding of spoken sentences. Nature, 568(7753), 493.




AIhub is dedicated to free high-quality information about AI.
AIhub is dedicated to free high-quality information about AI.

            AUAI is supported by:



Subscribe to AIhub newsletter on substack



Related posts :

Tech-savvy STEM students prone to letting AI do their thinking for them

  13 Nov 2026
How can students break their dependence on AI tools?

An invisible word of the day: watermarking assignment prompts to detect copy-pasted chatbot answers

  12 Nov 2026
SteganoPrompt lets educators embed an invisible but openly announced instruction in an assignment prompt.

AI100 longitudinal study examines how AI has entered the mainstream

  10 Nov 2026
Published every five years, the report is compiled by experts in the field.
AI pioneers

Thinking big – from constraint programming to the Holy Grail: an interview with Gene Freuder

  10 Nov 2026
In our latest instalment of AI Pioneers, we speak to Gene Freuder on the field of constraint programming, neurosymbolic and generative AI approaches in AI, and the bigger picture of computer science.

How attackers persuade AI agents to break the rules

  09 Nov 2026
As AI assistants evolve into AI agents, a study has found that the biggest safety risks in their use may not come from single malicious prompts, but from carefully orchestrated conversations.

Interview with Minji Park: humans in the loop to keep language models up to date

  06 Nov 2026
Human-AI co-inference through a shared editable state.

AI plus chemistry can expand battery electrolyte design

  05 Nov 2026
Researchers are using artificial intelligence to speed the search for better battery materials.
coffee corner

AIhub coffee corner: Are humanoids the future of embodied AI?

  04 Nov 2026
The AIhub coffee corner captures the musings of AI experts over a short conversation.


↑


AUAI is supported by:







Subscribe to AIhub newsletter on substack




 















©2026.05 - Association for the Understanding of Artificial Intelligence