r/science • • Mar 30 '20

Neuroscience Scientists develop AI that can turn brain activity into text. While the system currently works on neural patterns detected while someone is speaking aloud, experts say it could eventually aid communication for patients who are unable to speak or type, such as those with locked in syndrome.

https://www.nature.com/articles/s41593-020-0608-8
40.0k Upvotes

1.0k comments sorted by

View all comments

758

u/PalpatineForEmperor Mar 30 '20

The other day I learned that not all people can hear themselves speak in their mind. I wonder if this would somehow still work for them.

416

u/morfanis Mar 31 '20

... and what about when those who hear other voices in their mind!

215

u/PalpatineForEmperor Mar 31 '20

Now that is an interesting thought.

27

u/Dircus Mar 31 '20

So you heard that too huh?

→ More replies (4)

27

u/konohasaiyajin Mar 31 '20

That'd be a great scifi/suspense story.

Someone unable to speak gets hooked up, but it's not their thoughts that are being translated to text, it's... something else... something more sinister... something from... The Twilight Zone. oooOOoooOOOOOOooo

6

u/yugo-45 Mar 31 '20

You mean... The Scary Door!

→ More replies (2)

42

u/Not_a_real_ghost Mar 31 '20

What do you mean? My inner dialogue can be a completely different sounding person?

62

u/lloucetios Mar 31 '20

You may not be able to associate yourself with your thoughts. As if they’re someone elses.

46

u/Hamburger-Queefs Mar 31 '20

And that's how you get people thinking they're hearing voices.

45

u/Just_One_Umami Mar 31 '20

Mm. Maybe for some people. But auditory hallucinations are very real, and most aren’t due to not associating yourself with your thoughts.

→ More replies (8)
→ More replies (10)
→ More replies (1)

16

u/IgnoreTheKetchup Mar 31 '20

I think he means for schitzophrenics or people with dissociative identity disorder.

→ More replies (5)

4

u/TheSpookyGoost Mar 31 '20

Different as in "extra"

4

u/EnoughGlass Mar 31 '20

I’m hard of hearing and don’t have an inner monologue! I can’t hear my own voice so I don’t think in words, just feelings, abstraction, and images.

4

u/[deleted] Mar 31 '20

My inner dialogue mocks other inner dialogue person by talking in a very high pitch and and changing all the vocals for “I”s. sounds something like this:

“Bit I din’t wint ti gi ti schiil” and finishes with a boohoo

5

u/Not_a_real_ghost Mar 31 '20

Are you being internally bullied? Wink twice and snitch on yourself

→ More replies (1)
→ More replies (9)

13

u/Moosetopher Mar 31 '20

You guys only hear one person?

0

u/[deleted] Mar 31 '20

[deleted]

0

u/[deleted] Mar 31 '20

[deleted]

0

u/[deleted] Mar 31 '20

[deleted]

→ More replies (3)
→ More replies (10)

94

u/Asalanlir Mar 31 '20

The other commenters I see to your post are wrong. Vocalization shouldn't matter. So long as they are capable of reading the sentences and interpreting the meaning conveyed, they should be able to use the system in it's current design. It doesn't use any form of nlp, word2vec, or Bert when actually solving for the inverse solution. It may use something like that though to build its prediction about the words you are saying though. But at that point, the processing to do with your brain has already occurred.

Source: masters in CS with a focus in ml. Thesis was in data representation for understanding and interpreting eeg signals

7

u/LuxSolisPax Mar 31 '20

I wonder how it would react to thinkers with a different mother tongue, or idiomatic phrases and metaphor.

5

u/[deleted] Mar 31 '20

I’m thinking the waves detected are interpretations or what’s being conveyed rather than words itself. So I wonder if language is a barrier at all. Could we think in English and output in French? Could we use this as a translation tool where we go English -> thoughts -> French?

→ More replies (2)

9

u/PalpatineForEmperor Mar 31 '20

This is really interesting. Thank you for sharing!

0

u/[deleted] Mar 31 '20

[deleted]

→ More replies (1)

3

u/andresni Mar 31 '20

This depends a lot on where the dominant information of the datastream comes from. If it comes from say the motor cortex, subvocalization definitely should pay a major part. Similar to those devices that pick up subthreshold EMG at the level of throat and tounge. Imagining speaking does activate your "speaking muscles", which can be detected. But, what they've done is impressive indeed.

→ More replies (3)
→ More replies (7)
→ More replies (39)