conv.

All stories
ScienceQuiet 8d · day 10

New brain implant decodes speech and gestures at the same time

A 253-electrode BCI lets paralyzed patients speak and gesture simultaneously via AI, researchers report in Nature Neuroscience.

newest coverage 7d agosummary written 9d ago21 pieces5 likes & upvotes NewswiresMastodonHacker NewsGoogle NewsReddit

What to know

  • A single implanted device decoded both intended speech and intended gestures simultaneously for the first time, converting brain activity into on-screen text and avatar movement within seconds.
  • The system was tested in two participants with severe paralysis — one from a brainstem stroke, one from ALS — using a 253-electrode array on the sensorimotor cortex.
  • Researchers and outside experts describe it as an early proof of concept, not a ready-to-use product, but a step toward more expressive daily-use neural prostheses.
  • Separate NYT coverage the same day profiled a patient using a wireless brain implant to speak from imagined words, adding a human-interest angle to the research news.

“covers a fairly large surface area of the sensorimotor cortex, so it can capture signals related to both speech and body movements”

Samantha Brosler, Study co-author, UCSF bioengineering PhD student · Nature News ↗ · Sep 13

Samantha Brosler Study co-author, PhD student in bioengineering, UCSFChristian Herff Computational neuroscientist, Maastricht UniversityPam Belluck New York Times reporter

New brain implant decodes speech and gestures at the same time
nature.com

How it unfolded 2 developments, newest first · click a bar or a number to jump articlesposts

Peak 15 pieces in 3h at Sep 14, 10 AM; 21 pieces over 10 days (16 articles · 5 posts) Sep 13, 7 PM — 2 pieces · 1 article · 1 post — Mastodon 1, Newswires 1Sep 13, 10 PM — quietSep 14, 1 AM — quietSep 14, 4 AM — quietSep 14, 7 AM — quietSep 14, 10 AM — 15 pieces · 13 articles · 2 posts — Google News 8, Newswires 5, Hacker News 1, +1 moreSep 14, 1 PM — quietSep 14, 4 PM — quietSep 14, 7 PM — 1 piece · 1 article — Google News 1Sep 14, 10 PM — quietSep 15, 1 AM — quietSep 15, 4 AM — 1 piece · 1 article — Newswires 1Sep 15, 7 AM — quietSep 15, 10 AM — quietSep 15, 1 PM — quietSep 15, 4 PM — 1 piece · 1 post — Reddit 1Sep 15, 7 PM — quietSep 15, 10 PM — quietSep 16, 1 AM — quietSep 16, 4 AM — quietSep 16, 7 AM — quietSep 16, 10 AM — 1 piece · 1 post — Hacker News 1Sep 16, 1 PM — quietSep 16, 4 PM — quietSep 16, 7 PM — quietSep 16, 10 PM — quietSep 17, 1 AM — quietSep 17, 4 AM — quietSep 17, 7 AM — quietSep 17, 10 AM — quietSep 17, 1 PM — quietSep 17, 4 PM — quietSep 17, 7 PM — quietSep 17, 10 PM — quietSep 18, 1 AM — quietSep 18, 4 AM — quietSep 18, 7 AM — quietSep 18, 10 AM — quietSep 18, 1 PM — quietSep 18, 4 PM — quietSep 18, 7 PM — quietSep 18, 10 PM — quietSep 19, 1 AM — quietSep 19, 4 AM — quietSep 19, 7 AM — quietSep 19, 10 AM — quietSep 19, 1 PM — quietSep 19, 4 PM — quietSep 19, 7 PM — quietSep 19, 10 PM — quietSep 20, 1 AM — quietSep 20, 4 AM — quietSep 20, 7 AM — quietSep 20, 10 AM — quietSep 20, 1 PM — quietSep 20, 4 PM — quietSep 20, 7 PM — quietSep 20, 10 PM — quietSep 21, 1 AM — quietSep 21, 4 AM — quietSep 21, 7 AM — quietSep 21, 10 AM — quietSep 21, 1 PM — quietSep 21, 4 PM — quietSep 21, 7 PM — quietSep 21, 10 PM — quietSep 22, 1 AM — quietSep 22, 4 AM — quietSep 22, 7 AM — quietSep 22, 10 AM — quietSep 22, 1 PM — quietSep 22, 4 PM — quietSep 22, 7 PM — quietSep 22, 10 PM — quietYesterday, 1 AM — quietYesterday, 4 AM — quietYesterday, 7 AM — quietYesterday, 10 AM — quietYesterday, 1 PM — quietYesterday, 4 PM — quietYesterday, 7 PM — quietYesterday, 10 PM — quietToday, 1 AM — quietToday, 4 AM — quiet 12
Sep 14Sep 15Sep 16Sep 17Sep 18Sep 19Sep 20Sep 21Sep 22now · 6:44 AM ET
  1. 2

    NYT profiles a patient speaking again via a wireless brain implant

    The New York Times reported on a disabled patient whose wireless brain-computer interface enabled speech even from imagined words, framing it as the latest advance in the field alongside the Nature Neuroscience findings.

    “I Have a Lot to Say…”
    — patient profiled by NYT
    1. 5 outlets Brain-computer interface helps patient speak in real time

      first by ALS News Today, 9d ago · also KEYE, Nature, NR Times, Anadolu Agency

      4 more headlines
    2. 3 outlets ‘I Have a Lot to Say’: Brain Implant Helps a Disabled Patient Speak

      first by NYT, 9d ago · also FT, The New York Times

      1 more headline
  2. background

    Outside neuroscientist calls the result a step toward daily-use prosthetics — Christian Herff of Maastricht University, not involved in the study, said the combined speech-and-gesture decoding raises hopes for neural prostheses reaching everyday use.

  3. 1

    Nature Neuroscience publishes multifunctional BCI study

    A study describes a brain implant with 253 electrodes on the sensorimotor cortex that uses AI to translate brain activity into on-screen text and to animate a personalized avatar's gestures, tested in a stroke survivor and an ALS patient.

    “But most of these studies have focused on restoring one of these functions at a time,…”
    — Samantha Brosler
    1. 1 outlet Neuroscience: Brain implant brings speech and gestures together (Nature Neuroscience)

      first by Nature Asia, 9d ago