Decoding Speech from Brain Activity with surprising accuracy

imhotep

Well-known member
  • Mar 29, 2017
    14,823
    8
    35,328
    113
    An artificial intelligence can decode words and sentences from brain activity with surprising — but still limited — accuracy. Using only a few seconds of brain activity data, the AI guesses what a person has heard. It lists the correct answer in its top 10 possibilities up to 73 percent of the time, researchers found in a preliminary study.

    Developed at the parent company of Facebook, Meta, the AI could eventually be used to help thousands of people around the world unable to communicate through speech, typing or gestures, including many patients in minimally conscious, locked-in or “vegetative states”.
    Most existing technologies to help such patients communicate require risky brain surgeries to implant electrodes. This new approach could provide a viable path to help patients with communication deficits … without the use of invasive methods.

    This non-invasive method uses Magnetoencephalography (MEG) or Electroencephalography. With MEG the correct answer was in the AI’s top 10 guesses up to 73 percent of the time, and with electroencephalography, that value dropped to no more than 30 percent. The MEG performance is very good but it's use has practical limitations as MEG requires a bulky & expensive machine.
    The AI seems to perform above expected at this stage by using only 3 seconds of data from the brain.
     

    u_make_me_sick_

    Well-known member
  • Oct 1, 2011
    11,522
    7,320
    113
    An artificial intelligence can decode words and sentences from brain activity with surprising — but still limited — accuracy. Using only a few seconds of brain activity data, the AI guesses what a person has heard. It lists the correct answer in its top 10 possibilities up to 73 percent of the time, researchers found in a preliminary study.

    Developed at the parent company of Facebook, Meta, the AI could eventually be used to help thousands of people around the world unable to communicate through speech, typing or gestures, including many patients in minimally conscious, locked-in or “vegetative states”.
    Most existing technologies to help such patients communicate require risky brain surgeries to implant electrodes. This new approach could provide a viable path to help patients with communication deficits … without the use of invasive methods.

    This non-invasive method uses Magnetoencephalography (MEG) or Electroencephalography. With MEG the correct answer was in the AI’s top 10 guesses up to 73 percent of the time, and with electroencephalography, that value dropped to no more than 30 percent. The MEG performance is very good but it's use has practical limitations as MEG requires a bulky & expensive machine.
    The AI seems to perform above expected at this stage by using only 3 seconds of data from the brain.
    wow... it's indeed a breakthrough..
    the unknown part is how the US military going to use it in the future...
     

    kolavari

    Well-known member
  • Aug 11, 2012
    33,746
    1
    25,653
    113
    කැළෑ පොජ්ජේ
    How does this differ from the one that Stephen Hawking had?

    Read the article fully :P

    Most existing technologies to help such patients communicate require risky brain surgeries to implant electrodes. This new approach could provide a viable path to help patients with communication deficits … without the use of invasive methods.

    I don't know if this is the answer to your question. But this is also said in the same article :yes:
     

    imhotep

    Well-known member
  • Mar 29, 2017
    14,823
    8
    35,328
    113
    How does this differ from the one that Stephen Hawking had?
    Stephen Hawking had something totally different. A computer scrolled through common phrases on a screen, and Hawking could select what he wanted to communicate with the touch of a button. When he finally submitted the draft message, it was processed by a speech synthesizer which gave a sound output.
    It was based on old technology developed at MIT.

    This one is a novel approach. Basically it translates brainwaves into speech using a non-invasive technique. Of course it's still in early developement stages.

    Previously in 2021, the UCSF scientists were able to achieve a similar thing with a neuroprosthetic device.