Paralyzed Woman Can Use Digital Avatar to Speak
A woman who has been paralyzed for almost 20 years can now speak again through a digital avatar created by a team of scientists in California.
The new technology is able to translate her brain signals into speech and facial expressions — the first time this has been possible.
The 47-year-old woman, named Ann, lost her ability to speak more than 18 years ago after having a stroke that left her unable to move any of her muscles or even breathe by herself.
Over time she was able to relearn how to breathe, move her neck, smile, laugh, and even wink. However, to communicate she has had to use a device that allows her to slowly select letters using head movements at up to 14 words a minute.
In comparison, the new system can translate Ann's brain signals into words at a speed of nearly 80 words per minute.
To make this possible, the team implanted a paper-thin rectangle of 253 electrodes onto the part of Ann's brain which is responsible for speech. The electrodes can catch the brain signals that — if Ann hadn't had a stroke — would have been sent to her mouth, throat and face.
Ann then worked with the team to train an AI system to recognize her brain signals, by repeating different phrases. Once trained, the system could translate Ann's brain signals into a digital avatar's speech and the facial expressions for happiness, sadness or surprise.
A voice was also created for Ann's avatar using AI and a recording of her speaking at her wedding. Ann said hearing her avatar speak was "like hearing an old friend."
Although the system is not yet perfect, the scientists believe the level of accuracy is enough to be of practical use for people like Ann.
Ann, who hopes to work as a counselor for people with similar conditions, said taking part in the study has given her a sense of purpose.
"This study has allowed me to really live while I'm still alive!" she said.
