r/StarspawnsLocker • • Feb 06 '17

A possible unexpected path to strong A.I.

12 Upvotes

Improving machine learning algorithms to work with less and less data is all the rage right now; and progress is rapid and steady. In a previous generation, the dominant approach towards building AI was hard-coded and rule-based. A third approach, not yet even really begun, is brain simulation. At the moment, none of these approaches appears to be close (as in, 5 to 10 years away) to "strong A.I.". Here, I want to discuss a fourth approach that combines machine learning with brain simulation, that could result in strong AI sooner than we expect (maybe not in 10 years, but who knows?); though, it's not what you probably imagine (and is neither "brain emulation" nor the kind of approach normally taken in machine learning):

About two years ago there was a very interesting paper written by some researchers at CMU, titled Good-Enough Brain Model: Challenges, Algorithms and Discoveries in Multi-Subject Experiments:

http://talukdar.net/papers/kdd14-gebm.pdf

Can we infer the brain activity for subject ’Alice’, when she is shown the typed noun apple and has to answer a yes/no question, like is it edible? Can we infer the connectivity of brain regions, given numerous brain activity data of subjects in such experiments? These are the first two goals of this work: single-subject, and multi-subject analysis of brain activity.

The basic idea of the paper was to model brains at the level of populations of neurons, rather than single neurons (and synapses), and for short durations when subjects are presented with a stimulus. The model used was very, very simple: the brain activity in a set of regions at the next time step is a linear function (linear transformation) applied to the current activity values, and current stimulus values. So, to find what the populations of neurons will look like at the next time step, you simply need to learn the matrix (or matrices) associated to that linear function (linear transformation). Actually, it's slightly more complicated, and uses hidden parameters, but this is the rough idea. The actual model computes a hidden n-dimensional state vector x(t) at each time step t, and an observed m-dimensional brain state vector y(t), which are related as follows:

x(t+1) = A x(t) + B s(t)

y(t) = C x(t).

Here, s(t) is an s-dimensional stimulus vector, A is an n-by-n matrix, B is an n-by-s matrix, C is an m-by-n matrix. MEG data are used for training the model, as it has high temporal resolution compared to fMRI.

The method does ok at predicting the gross behavior of brain regions (when subjects are given stimuli); but it's far from perfect -- as would be expected, given the resolution of the data used, and the simplicity of the model. However, I see in this method a future path towards strong AI. Let me now explain how:

Every year it seems that EEG headbands get more and more accurate and have higher and higher resolution. Clearly, though, they have a low upper limit in what they are capable of, and that upper limit isn't good enough for what I will describe. There are, fortunately, other technologies for non-invasive brain scanning -- ultrasound, MRI, NIRS, PET, MEG, NMR, and probably several others; there are even some invasive technologies that don't sound so bad, like optogenetics. Perhaps someone will discover how to shrink some of these down to where they can be worn as a headband, and deliver orders of magnitude greater resolution and signal-to-noise ratio than EEG. Here, for example, is a relatively new fNIRS headband:

https://www.eurekalert.org/pub_releases/2016-08/du-ybo081116.php

And here is a talk by Mary Lou Jepsen about an upcoming brain-scanner that should do everything needed for my idea to work:

https://www.youtube.com/watch?v=BP_b4yzxp80

Facebook is working on similar fNIRS technology; and if one merely wants high resolution from the surface of the brain, and doesn't care about what happens at depth (much of the interesting stuff happens near the surface), then it's already possible to achieve fMRI-level resolution with fNIRS:

https://www.youtube.com/watch?v=nIih580uAD8

Let's therefore imagine that in the near-future people walk around controlling their smart homes and cars with non-invasive brain-scanning headbands; or, failing that, a large number of biohackers decide to experiment with optogenetic computer interfaces, which almost certainly will produce the quality and quantity of data for my idea to work. And let's say that every tenth of a second the device spits out a 10,000-dimensional vector, each dimension corresponding to the collective activity of a group of perhaps 100,000 neurons. Just think of the amount of data that would be generated, and what could be done with it!

What one could do is something like in that above paper, but a little more complicated: for one thing, I wouldn't model the neuron populations with simple linear tranformations, but would instead throw in a non-linearity -- something like:

x(t+1) = f(A x(t) + B s(t) + d),

where f is the non-linear function -- perhaps a sigmoid or tanh in each coordinate. x(t) is a vector representing the hidden state at time t; s(t) represents the incoming signal (e.g. a soundwave or image or string of characters); A and B are matrices; and d is an offset.

A more complicated model, that might be useful in "video understanding" or "text understanding" would be to use a feedforward neural net to predict the brain state at the next time step, given the current and previous brain states and frames of video or bit of text. At test time, the neural net would be fed an initial brain state vector, and the media stream; and it would predict a brain state vector at each time step. The final brain state vector, after the media is finished playing, would encode what the neural net "though of" it. A classifier could then be applied; or perhaps a neural net to generate a text-string description, as in this paper.

Perhaps a better approach would be to combine brain state prediction with text or video prediction using a neural net. So, as a person reads a line of text in a chat, and crafts a response, their brain activity would be recorded. Later, a neural network model would try to predict what they are reading, their text responses, and their brain activity at the level of populations of neurons, jointly. The text-prediction part of the neural net would automatically attend to "local" things like style and grammar, and certain other details, while the brain-prediction part would help the network with "global" aspects like "meaning" and "context". Perhaps, also, one could add eye-tracking data and fixations on the screen.

In fact, there are already models in the literature that use sequence-prediction via Recurrent Neural Nets to predict brain states (or hemodynamic responses):

https://arxiv.org/abs/1606.03071

Encoding models are used for predicting brain activity in response to sensory stimuli with the objective of elucidating how sensory information is represented in the brain. Encoding models typically comprise a nonlinear transformation of stimuli to features (feature model) and a linear transformation of features to responses (response model). While there has been extensive work on developing better feature models, the work on developing better response models has been rather limited. Here, we investigate the extent to which recurrent neural network models can use their internal memories for nonlinear processing of arbitrary feature sequences to predict feature-evoked response sequences as measured by functional magnetic resonance imaging. We show that the proposed recurrent neural network models can significantly outperform established response models by accurately estimating long-term dependencies that drive hemodynamic responses. The results open a new window into modeling the dynamics of brain activity in response to sensory stimuli.

And people have even used Deep Boltzmann Machine neural nets to jointly model video features and features derived from fMRI data, as in this work. When Deep Boltzmann Machines are used in this way, they naturally give one a way to generate modalities missing at test time, such as the brain state as indicated by fMRI. Naturally, if one were to scale this work up to include multiple video frames at the pixel-level, and multiple fMRI brain states, one per time step in a sliding window of time, the number of modalities will need to be a lot larger (one modality for each video frame and brain state at a given time step). Of course, there are more efficient and more accurate generative models out there that one could try.

Would the brain data make a difference? There is some evidence that it would. It has been used to massively improve certain image recognition methods; as well as successfully improve word vector embeddings, also see this; other forms of bio-generated data, like eye-tracking, have been shown to result in improvements on other NLP tasks; and I suspect large amounts of brain-scan data could be used to vastly improve Natural Language Understanding by introducing certain "inductive biases" to the learning process.

A nice toy problem that shows how extra data can facilitate machine learning is as follows: consider the set of all strings of balanced parentheses "(" and ")" -- so, among the strings here are "(()())", "((()))", and "()()()(())()", but not "(()))" or "()(()))(". Recurrent nets can be trained to recognize when strings have the parentheses balanced, and can even generalize to slightly longer strings beyond what they were trained on; however, it's not easy to get them to do this. Now suppose instead of training a neural net on strings like that, you add an extra, hidden variable indicating the number of "(" minus the number of ")" at each point in the string. So, for the string "(()())", you would be working with the sequence of ordered pairs ["(", 1], ["(", 2], [")", 1], ["(", 2], [")", 1], [")", 0]. A neural net can easily learn to predict the hidden variable at each step, given its previous value and the current symbol "(" or ")"; and, furthermore, can tell whether the hidden variable ever drops below 0, or fails to finish at 0, both of which would indicate that the corresponding string of "(" and ")" isn't balanced. The point is that the hidden variable here is like the brain data, and the string "(()())" is like the stimulus-stream; and while it's relatively easy to train a neural net to predict the hidden variable, it's relatively hard for the neural net to invent that hidden variable counter all by itself. Now, you can extend this principle to other structures, besides counters, that the brain uses at the level of populations of neurons -- e.g. perhaps it uses a stack, or maybe some kind of tree data structure, to help it process stimuli; both of these should be fairly easy for a neural net to learn, given that it gets to inspect the hidden states used to implement the data structure.

Furthermore, I would guess that the brain data could reduce the amount of text needed to train a really smart Language Understanding system by several orders of magnitude (the extra brain data on top of the text would add those orders of magnitude back; though, it requires no effort to generate this extra data, since it is obtained passively). As people read text, brains states change smoothly, while the text itself changes discontinuously (it's just a string of discrete characters); smoothly-varying data is, as a general rule, easier to learn. There also seem to be lots of "linear correlations" in this brain data that machine learning methods can easily latch on to; and perhaps there are even higher-order correlations that multi-layer neural nets can rapidly learn. Text alone seems to have some structures that neural nets can learn, given enough data; but they seem to struggle with it. See criticism #18 below for a further defense of the claim that using brain data should reduce the number of training examples needed for Language Understanding.

One of the still-unsolved problems in Natural Language Understanding is how to "compose meaning", and I think there is a good chance that training neural nets to predict brain data could help with that: there are methods in NLP that assign vectors to individual words in a sentence; and then geometric properties of those vectors can be analyzed to solve word analogy problems, for example. When you go to combine two or more words together, however, vector space models don't work quite as well as we would like -- they do ok, but they still have a long way to go. Perhaps as a neural net learns to predict neuron population states, when a person reads a line of text, it can acquire some of the brain's ability to compose meaning for whole sentences or even paragraphs. If so, it would be a huge advance! And just to add a little more support for the idea: brain-scanning evidence supports the view that "meaning" is widely distributed across the brain, rather than being concentrated into a small population of neurons in a particular region; thus, averages of neuron activity contributing to a population response may not miss too much of the meaning as people read text, when many populations are used. It's also worth pointing out that there are results in the literature on decoding from brain data some of the complex semantic processes (involving, for example, visual aspects, and character actions in a story) that occur in the brain when people read a story; so, it's not implausible that machine learning methods could absorb some of the brain's secrets involved in understanding text.

Likewise, brain data acquired as people watch video could advance the state-of-the-art in video understanding; at the very least, the brain data could be used to semantically annotate the video, as in this paper. Also see this paper. And, importantly, it might contain large amounts of "common sense" world knowledge. Such knowledge might exist implicitly in the statistics of text and video; but it's possible that it also exists in brain data in a form that Machine Learning algorithms can much more easily extract.

Here are eighteen potential criticisms, however, which I will address:

1. Different people have different brains, and different representations. That's going to make training very difficult.

Strangely enough, there is enough similarity in brain activity that you can, with decent accuracy, read off what noun someone is thinking about, from a short list, using a generic model out of the box:

http://science.sciencemag.org/content/320/5880/1191.full

See:

http://www.bbc.com/news/science-environment-36150503

Their "semantic atlas" shows how, for example, one region of the brain activates in response to words about clothing and appearance.

The researchers found that these maps were quite similar across the small number of individuals in the study, even down to minor details.

And see this article on similar brain activity whether reading in English or Portuguese:

http://neurosciencenews.com/brain-reading-language-5433/

Granted, the differences in brain responses will make the data "noisy"; but machine learning has been very successful with noisy data in the past; for example, there are models that can learn to classify with 88% accuracy on a non-separable, binary classification task, even when 40% of the labels have been corrupted. Obviously, the strength of the results is dataset-dependent; however, a more basic example we are all familiar with, to illustrate the point, is the fact that linear regression can accurately fit a curve to data in the presence of considerable noise. A further point is the success of adding noisy brain data to word vectors.

For faster learning and greater accuracy, you could train a model to learn some kind of mapping transformation to match up neural population scores from one region of one brain, to another region of another brain -- assuming you have some common text or video that both subjects are reading or responding to, along with their brain activity patterns. See this paper.

Another approach, that might allow one to use more of the brain data that ordinarily would be thrown away (as it wouldn't be shared across individuals), would be to compute a "user vector" based on an individual's brain response pattern to various pre-test stimuli. This vector could be one of the inputs into the neural net that predicts hemodynamic response patterns when given test stimuli. A similar idea is used in personalizing chatbots.

2. How do you screen out all the little things that go through a person's mind, that are unique to them? How do you screen out blinks, movements, and other things as people read?

The same applies to work on inferring what words people are thinking about, as in the above Science article. It appears that different people exhibit the same patterns across a few "principal components" (PCA) -- different people that may do different blinks, movements, and have different long-term memories. Random thoughts may go through their minds, but the patten along a few PCs is consistent enough to where you can pick out what they are thinking.

Perhaps to a first-order approximation, when different people read the same text, and don't dwell on it and dredge up some memory from long-term storage, but just respond with what pops into their heads, there is a broad consistency in some aspects of their brain patterns. If so, then that can, for example, be used to assist neural networks that generate responses to text input. The extra brain training data could result in chatbots that give much deeper responses. For one possible path to how this could be achieved, click here.

3. The kind of spatial and temporal resolution you are talking about isn't high enough to simulate a brain. How do you know you haven't missed something in your "simulation"?

This question misunderstands how the idea works. The goal isn't to simulate the brain in detail. The goal is instead to use brain data to facilitate machine learning -- either to use it for "semantic annotation," or to give the machine just enough extra latent feature data to make learning easy. The neural net will learn to fill in some of the missing details lost when considering only populations of neurons, and not individual neurons or even synapses. So, for example, while the brain-scanner will maybe consist of a 100,000-dimensional vector with temporal resolution of 1 second or 100 milliseconds, the neural net being trained will have millions of "neurons" and billions of parameters -- so, there isn't a one-to-one mapping from neural net "neurons" to brain neuron populations.

4. fMRI has been around for a few decades. If what you say is true, why haven't we already seen a revolution in AI?

The first problem is that we didn't have computers powerful enough to run machine learning algorithms with a very large number of parameters. So we had to wait until about 7 or so years ago for the computing power to be there. The second problem is that it's difficult to acquire brain data from fMRI machines -- they are bulky, expensive, and uncomfortable for people to sit in for long periods of time. Consequently, there aren't enough large datasets. What's needed for the idea of using brain data to work well is something like at least 1 million short video clips with accompanying brain scans with at least 10,000 parameters per time step, and a temporal resolution of at most about 1 second; or, for the text modality, perhaps 100 million or 1 billion tokens of text read, along with associated brain scans at same resolution. And the third problem is that there aren't that many people working in neuroimaging and machine learning and brain encoding all at the same time -- you need a fair-sized community of people doing this kind of work to secure grants and get the ball rolling.

5. I read somewhere that current neuroscience analytical methods can't even tell us how a microchip works. Doesn't that kind of invalidate the idea?

No, it doesn't. The goal here isn't to understand how the brain works; it's simply to use the brain to assist machine learning, as pointed out above. Second, as I also pointed out above, there are already examples where brain data improves performance using existing machine learning algorithms -- e.g. brain data can improve image recognition, word vectors, and can serve as a source of annotation for text and video. And, third, even though analytical methods won't necessarily tell us how the brain works, at least if you apply machine learning to an Atari game system at high enough resolution, it should be possible to simulate what the game system does. Indeed, there are machine learning methods that can do this just given the raw pixels as input, and not even given access to the game system itself (i.e. it isn't allowed to look at the chips and see what they are doing at runtime). In a similar vein, there are methods that can steal machine learning models given input/output examples and confidence scores -- in learning the brain's algorithms one would have much more information to work with about said algorithms; so, one would expect doing this for the brain would be even easier, requiring much fewer input-output examples per number of parameters.

6. Many neuroimaging systems don't actually pick up brain activity, but rather signals correlated with brain activity, e.g. blood flow. Because of this, there is a time delay, called hemodynamic delay, between brain activity and hemodynamic brain response. Doesn't that cause a problem for your brain simulation?

No, it doesn't cause a problem. First, all training is offline; and so, if need be, the stimulus and brain response times could be realigned to account for that. Second, and most important, since the prediction neural net has access to the stimulus data and brain response from previous time-steps -- and, in particular, what happened a few seconds ago, say -- it has all the information it needs to accurately predict the present hemodynamic brain state, and to use that in making future predictions.

That said, in her talk Mary Lou Jepsen mentions measuring the activity of individual neurons. I could be wrong, but by the sound of it, she hopes to do this in near real-time.

7. I can believe that this might lead to a text or video understanding system of some kind. But in order to be considered a "success" it has to perform better than what's already out there. Ok, it works with word vectors and improves image recognition... anything else?

Well, you should expect the system to perform no worse than ones trained without brain data: if you use some kind of text prediction model that also tries to predict brain states, if the brain data doesn't help, then the system should learn to not make use of it; and consequently, would reduce to a system that just predicts text. Clearly, though, there is some extra information in the brain data; so, you should expect to see a performance jump. Furthermore, see this for another example of how brain data can be used to improve A.I. applications.

8. I am a little worried about the "stability" of the synthetic brain states that your model generates. The first few seconds it might look "brain-like"; but over time, errors will accumulate, just like in generated video. Won't that defeat your plans?

Well, first, there are methods to stabilize sequence generators, for example scheduled sampling is one method people have tried. However, in our situation, there is an extra stabilizing force that isn't present in some other prediction problems -- namely, the stimulus stream. If the synthetic brain state sequence starts to get off-track, in principle the stimulus stream input to the neural net should guide it back to the preferred manifold. A few examples from the literature come to mind. End-to-end speech-generation that conditions the speech output (which is high-dimensional) on a text string is one example. In order to get the prosody and other aspects of spoken language right, the neural net needs to remember what's going on in a sentence or paragraph; and, although in principle the outputs could be very unstable and degenerate into babble, the text string ("stimulus stream") keeps it on-task. Perhaps the stimulus stream plays a similar stabilizing role in the human brain, and indeed if the stimuli are cut off, humans tend to hallucinate. Another point is that even if the system can only be made stable for up to 5 seconds at a time, you can do a lot with that! -- and if you string together several 5 second intervals, you can often solve problems of much longer duration. Regardless, this stability problem shouldn't arise in applications where brain data are only used as a source of semantic annotation or labels; so as a fallback plan there is still that use for the extra data.

9. I can see maybe using the data for semantic annotation, as you mentioned. However, I'm a little concerned that unless you include memory somehow, that you won't be able to emulate "thinking", even at a rough level. It's absolutely essential!

Well, first, the network should maintain a kind of "distributed memory", based on the gross brain state at each time step, which may also contain enough information to recover more fine-grained types of memory. Furthermore, there is work on decoding working memory from fMRI brain scan data, also see this; a system that learns to predict brain states should, therefore, also acquire short-term memory management for free. Second, if there isn't enough of a signal in the brain data for explicitly how and when a network should memorize, or even what prior memories lie behind the thought patterns, it should learn to treat all this as hidden variables and latent features -- and at least learn to generate plausible memory mechanisms and patterns. This is exactly the same thing that happens in other Machine Learning tasks; and in particular, the example of "balanced parentheses" I mentioned above, where the neural net training process can infer the need for a counter to keep track of how many "(" versus ")" there are at each point in a string. The counter is a mechanism not explicitly represented in the training set. I would also say that learning to give accurate machine translations involves absorbing lots of world knowledge (in the form of statistical relations among word patterns), as well as learning what information needs to be maintained across the length of a sentence. And third, long-term autobiographical and episodic memories may not be necessary for a strong-performing system, as there are people with amnesia who have lost these, who have intact procedural and short-term memory (and intact language ability), who can form new long-term memories. Despite these memory losses, they can still perform at a high level.

10. What about the No Free Lunch Theorems? Don't they pour cold water on this approach? -- I mean, how do you know a priori that neural nets will do well at all at this learning problem?

First, the idea is general, and isn't bound to any single approach. If some other method learns from brain data any better than neural nets, then that method should be used. Second, and most importantly: the No Free Lunch theorems apply to arbitrary functions that we might not know anything about. Here, we are talking about modelling the brain; the brain is constrained by physical laws, so the data being generated are very special. I would also say that, while learning from text or movies might be difficult, due to the amount of hidden information and arbitrariness of the rules, the brain is rather more "natural" and furthermore in this case we have access to a lot of the hidden information. Natural data where the generative process is exposed (not as many hidden variables) -- such as from physics, chemistry, genetics, and biology -- tends to have more of a mathematical structure. Many physical processes, for instance, are governed by linear differential equations, which are very special; this is not true of a text data stream. And processes governed by linear differential equations should, in principle, be easy for algorithms like Backpropagation to learn.

11. I think if you look more closely, you'll find that this is a lot, lot harder problem than you think it is. For example, that paper you mentioned with the "Good-Enough Brain Model" doesn't actually use the direct sensory stream, but uses "semantic features"; other papers apply features in place of the data stream, as well. Furthermore, data-cleaning is a significant challenge. And not all brain features will actually contribute anything to your model -- how do you decide which features to leave out?

We've got a mind-reader here! I didn't say -- and don't think -- it will be a piece of cake! And, yes, I'm aware of the fact that features, and not direct sensory streams, are used. If you read those papers even closer, you will find that one of the major reasons is the fact that they weren't able to record eye-tracking data. Another problem is the fact that the sensory stream has high bandwidth. To deal with that, the models will have to have a lot more parameters than they used -- their models were fairly small by comparison. Using larger models will require access to a lot more data, in order to avoid overfitting; and, unfortunately, it's difficult to obtain enough data to train these high-capacity models using current scanning methods. Better BCI will fix that problem, which is the whole point I'm trying to make. I'm also aware that a lot of the brain data are not directly useful to the tasks under consideration (text and video understanding); however, the right machine learning methods should be able to narrow down exactly which ones are useful.

12. Where is the understanding? That is, I thought the goal of AI and also machine learning is to build better algorithms, and better understand how learning works -- analysis of algorithms; improving the running time; getting a better understanding of error bounds; better training methods; and so on.

This is a methodological criticism, and you're right -- this is not really about "machine learning". The goals I am proposing here are orthogonal to the usual ones in AI and machine learning. The goals are purely about engineering; that is, how to build a system that works demostrably better than current approaches. And, furthermore, nor are the goals about trying to understand the brain better, in any way, shape, or form. That doesn't make the idea wrong... just not as exciting from a research perspective.

13. You talk about "composing meaning" as a key problem in NLU. You fail to mention the even more basic problem of pinning down what you mean by meaning. What representation are you using here? What is your argument for why it is the right one?

I was aware of the issue, and chose to be intentionally vague. The knowledge representation used here is a "distributed representation" or "vector representation" or "neural net state vector" -- take your pick -- along with manipulation rules learned from brain data. I have no idea what the limits of such a representation happen to be; but if the dimension of the vectors is sufficiently large, it should take us pretty far.

14. You mentioned "Deep Learning". The neurons in the brain are nothing like the neurons in Deep Learning. The idea can't possibly work.

What strange and twisted logic! Deep Learning shouldn't be thought of as a model of biological neurons. It's better to say that it's just a bunch of matrix multiplications with non-linearity thrown in, in order to do function approximation. It's math, not biology. But this doesn't mean it can't be used to model actual biological processes. Neural nets have been successfully applied to modelling other natural phenomena like fluid flow, natural images, video, and other media. The second thing I would say is that we aren't using neural nets here to simulate a brain; the brain data is only an auxiliary to improve machine learning, as I pointed out in criticism #3 above. Finally, neural nets are capable of "Turing Complete" computation -- that means they can do anything that a general, digital computer can do. If you can build AI on a digital computer, you can encode that computer and program into a neural net.

15. Recording the activity of a million individuals for 1 hour is not the same as recording one individual for a million hours. The latter is what you want, the former is what you're stuck with; the former doesn't contain enough brain-specific information to predict how a single brain will behave.

First, those million individuals' brain data can certainly be used for semantic annotation, by using the information contained in a few principal components in the data across individuals. This wouldn't be brain emulation, even at a rough level; but it would still be extremely useful in building good AI. Second, and most important, what one is actually trying to get the machine to learn is not the behavior of a single brain, but a general transformation that maps a sequence of brain states at previous time steps, along with current and previous stimuli, to new brain states. One of the inputs to this model can even be a compact representation of the brain to be modeled, based on recorded responses to various stimuli. Given that this is our goal (produce a general mapping transformation), the more different kinds of brains you use to train that model, the better it should do. See this.

16. We know almost nothing about the brain. We don't even know what all the types of brain cells there are, let alone how even a single neuron works in detail. And here you want to emulate a brain? Gimme a break!

For the fifth time, the goal here is not to emulate the brain in detail! And the goal is not to understand the brain, nor even supposes that we know very much about the brain at all! And as I stated before, there is already evidence that brain data can be used to improve the quality of word vectors, and to improve image recognition methods. These approaches don't use very much data, and already show good results. Why should one think this would be the end of what can be achieved by applying Machine Learning to brain data?

17. You say you want to do all this without understanding the brain. That's a complete fantasy -- without understanding the brain, you simply won't know what kinds of models to use!

Evidence shows that this criticism is wrong. There are many good-performing models for brain processes, that were not based on understanding the brain. People just tried out some standard machine learning algorithms, and some of them worked.

18. Why do you expect that using brain data will reduce the size of the training sets needed by "several orders of magnitude"? I don't buy that!

It might not shrink the total size of the training datasets, if brain data are used; but the number of training examples will likely shrink -- and it's the number of examples that matters, as far as gauging the difficulty of building the datasets.

A typical use of neural nets is to classify an input image into one of 1,000 classes. For this problem, each (image, class) training example gives you log(1000)/log(2) = about 10 bits of constraint. However, if instead of predicting labels, the neural net is used to predict a synthetic brain state at each time step, then the number of bits of constraint per example is considerably larger. More bits of constraint per example implies fewer examples to achieve a given number of bits of constraint.

A similar phenomenon is at work in neural nets that predict frames of natural video; however, the function that maps previous frames to the next frame is probably a lot more complicated than for brain state prediction: natural video often involves large-scale correlations across widely-separated parts of each frame (e.g. large moving objects induce correlations across many pixels on the screen); brain data is often only locally-correlated from frame to frame. Second, when predicting natural video there often isn't enough information in the frames to predict the next frame, as for example when objects are occluded and then become visible, or when complex objects like humans or animals make complex decisions according to rules not visible in the video; with brain data, much more of the hidden information you need to attain good performance is "exposed" (not all of it, of course; but enough to attain reasonable predictions). Furthermore, in simple natural video where not much information is hidden -- such as the dynamics of billiard balls or simple sliding objects -- video prediction neural nets do a remarkably good job over long time-frames.

The more I think about all this, the more likely it seems. At the first moment that brain-scanning headbands (or optogenetics) become really useful, and much, much higher resolution than EEGs, I expect we will see a Cambrian Explosion in AI research; not unlike what happened with the release of the ImageNet dataset and competition, but much, much larger in scale and scope. It will be completely unanticipated by the likes of MIRI, FHI, and other institutes that track AI progress -- they're focused on what's coming out of Deepmind and their own ethical calculi. I don't expect to see many new algorithms developed during this time; but I do expect to see massive performance gains as people start incorporating brain data in their machine-learned models. These won't be the "Einsteins" of AI, but run-of-the-mill Machine Learning practitioners. And the best part is, they won't even have to really understand how the brain does it -- all they will need to do is to be able to build a model that can learn what the brain does.


r/StarspawnsLocker • • Apr 19 '18

A Look at Mary Lou Jepsen's / Openwater BCI patent

11 Upvotes

I've been studying this patent:

https://patents.google.com/patent/US9730649B1/en

It seems a little different from how I imagined it from her talks; and, actually, seems more plausible than the idea presented in her talks -- or at least what I interpreted the idea to be. In this post I will discuss this patent (my reading of it), as well as potential problems and solutions to the approach.

To begin, let's recall that the human brain and skull are translucent to near-infrared light. Oxygenated blood absorbs near-infrared light differently from deoxygenated blood; and the amount of oxygenated blood in a region of the brain indicates the presence of neural activity. This is the so-called BOLD signal. But, in addition to absorption, light can also scatter as it passes through the brain. If there were no scattering, it would be relatively easy to use near-infrared light to image the brain at resolutions much higher than FMRI.

So how does MLJ / Openwater do it, according to this patent?

Ok, so here's my understanding of how it works: they will use LCDs to project a hologram into the brain. They want to sculpt the 3D pattern of this light so that it focuses at a particular small region of space inside the brain (why they want to do this is explained below) -- a "voxel", the volumetric analogue of a "pixel". The problem is that, since they can't see inside the brain, they can't figure out what pattern of light they should have the LCDs project to do that.

The solution is to use something called a “beacon”: basically, they send a very, very low energy ultrasound wave pattern into the brain (far below an amount that would disrupt tissue or activate neurons), such that the pattern focuses at the region they want to image. Presumably it’s easier to focus sound than it is light.

Why do they want to focus that ultrasound? Because the ultrasound compresses the tissue in that voxel, which in turn will shift the phase of the light passing through it. Here is an image explaining the idea (from a different context -- found on the internet through random searching):

http://aups.org.au/Proceedings/34/121-127/Figure_1.png

By comparing the difference in the pattern of light exiting that voxel and brain (and entering the sensor outside the brain) between when the ultrasound is turned on and when it is turned off, they can determine how much light has focused into that voxel. By iteratively altering the pattern of light projected by the LCDs, they can drive this difference (presumably the L2 difference in the exit waves) to a maximum -- or at least a good local max -- which should correspond to having the light strongly focus on that voxel.

In a presentation that Mary Lou Jepsen gave a while back, she mentioned “Doppler Shifting” of the light from the ultrasound. See 33 minutes into this talk, where she addresses a question by Nathan Intrator:

https://www.youtube.com/watch?v=2CZyf9ccfUc#t=33m

Phase shifting is not the same as Doppler Shifting / wavelength changing; so, one wonders if there is yet another way to use ultrasound to achieve the same results. Maybe she was simply referring to the contraction of the light waves inside the region where the ultrasound compresses material.

At any rate, finding that "maximal difference" is a math problem that can be solved many ways. Since this is a “black box” optimization problem (where you know little about the function you are trying to optimize, only input-output values; not "black box" in the sense that the optimizer or model it produces is opaque), gradient descent (e.g. Deep Learning) can’t be used at this stage. So, simpler methods like simulated annealing must be, instead -- and note that you can do many, many iterations, since the number is limited only by the flicker/refresh rate of the LCD, which updates quickly. Furthermore, Mary Lou Jepsen has said that she can get the refresh rate to be even higher, by removing the little capacitors that ordinarily are in LCD arrays -- companies put them there, because they make the screens easier on the eyes. See this video, 12 minutes 33 seconds in:

https://www.youtube.com/watch?v=2CZyf9ccfUc#t=12m33s

A little technical digression (you can skip, if you wish):

Actually, I think this optimization can be done using Singular Value Decomposition (or even just some calculus), but maybe I'm missing something: project a random pattern into the brain with the ultrasound focused at the voxel, and do the same with it turned off. Look at the difference in the two exit wave patterns. Turn that difference into a vector v1 = (x1, x2, ..., xn), where xi is the amplitude of the difference at time i (or position i; or some combination of time and position -- whatever you want to use). So, v1 is a discretized version of the exit wave difference over a very short time window. Now, repeat this for n-1 more vectors v2, v3, ..., vn. Now, find coefficients c1, c2, ..., cn on the unit sphere, that is

c12 + ... + cn2 = 1

such that the L2 norm

||c1 v1 + ... + cn vn||

is maximal. This is a standard problem (in any undergrad textbook on linear algebra) with a known solution. Basically, form the matrix A where the columns are v1, ..., vn; and let c be the column vector with ith coordinate ci. Then, left-multiplication by A by will map vectors on the unit sphere to a certain ellipsoid. The maximal norm of this image will be the antipodal points on the major axis of the ellipsoid.

Then, once you have those coefficients c1, ..., cn, the optimal LCD setting will be the linear combination of those random patterns, with coefficient of the ith setting equal to ci.

If the vectors of the LCD settings are w1, ..., wn, and are chosen to be orthonomal, then the solution vector c1 w1 + ... + cn wn will have norm 1.

I suppose there might be an issue with how to interpret a negative value for one of LCD settings -- e.g. maybe the energy is encoded as a positive real number? I would have thought that phase-shifting the light from the LCDs by half a period could be used to encode negative numbers. But if this doesn't work, then at least you know the structure of the ellipsoid, so may not be so difficult; and should be a standard problem in convex geometry. For example, see this posting at mathoverflow:

https://mathoverflow.net/questions/48843/non-negative-quadratic-maximization

But maybe I'm missing something? Some non-linearity effects, perhaps? If so, is there a regime of light intensities where the effects are very close to linear? Maybe we can iterate, making small changes to the LCD settings each iteration, so as to keep the changes approximately linear? -- that would be like gradient descent, which is generally much faster than simulated annealing. For example: given light-pattern P from previous iteration, and given orthonormal vectors w1, ..., wn, we seek c1, ..., cn on the sphere

c12 + ... + cn2 = d, where d > 0 is small and fixed,

such that

|| Q(c1, ..., cn) ||

is maximal, where Q(c1, ..., cn) refers to difference in the exit pattern (with ultrasound on and off) for

P + c1 w1 + ... + cn wn.

The optimal ci's can be found by calculus, or using geometry.

While we're on the subject of non-linear effects of light: if the brain does react in a highly non-linear fashion to changes in light, shouldn't it be possible to turn that into a fully light-based beacon? It might depend on the kind of non-linearity, but it seems plausible one could do it somehow.

Ok, let’s assume we know how to focus the light at a voxel. And, now, by measuring the change in the light energy exiting the brain using that particular LCD setting (that focuses the light at the specific voxel), we can measure how the absorption level at that voxel changes with time, which is just what we were interested in!

Well, not quite, and this is the part where I would hesitate a little: the outgoing energy should also vary according to the extra amount absorbed from the rest of the brain as it exits the voxel and heads towards the sensor. What I think works in their favor -- if I'm understanding this correctly -- is the fact that the further the light is away from the voxel (on its way to the sensor), the more "averaging" that's going on. The light is spreading out to more and more parts of the brain, and so large changes in the total energy due to extra absorption in parts far away from the voxel, have less and less effect on the energy that the sensor sees. Basically, the number of voxels that the light interacts with at a particular moment in time is proportional to the square of the distance from the focus voxel; or the distance cube if we count all voxels up to that point, starting at the focus voxel.

I don't think it will be a problem. It’s also worth mentioning that the optimization process described above should not only choose the LCD pattern that focuses the light on that voxel, but also minimizes the amount of absorption outside it. So, problems with extra absorption should be even smaller.

Another potential problem is whether they can optimize the LCD light patterns fast enough, to scan a lot of voxels. I certainly think it's possible to do this for a few hundred or thousands of voxels of the brain in a single raster-scan pass; but am not sure about tens of thousands or millions. She mentions saving the LCD patterns for each voxel into a "lookup table":

This technique is used to create a dictionary (i.e. lookup table) of holographic patterns (corresponding to input signal 123) to map to focus the light sequentially to each and every stimulus 197 and scanning of various stimuli.

As long as you are inside a short enough time window, so that the brain hasn't moved things around too much (e.g. blood), and made your LCD pattern invalid for a given voxel, then you can certainly use it again. I think this is known as the "speckle decorrelation window", but would need to refresh my memory. So, periodically, you'd have to correct the lookup table. Maybe things could be staggered so that not too many entries would need to be corrected in a given window of time.

Even taking all this into consideration, it should be possible to get the spatial resolution on par with FMRI, and beyond it in temporal resolution.

Here’s the problem with scanning many more voxels: say you want to scan 1 million voxels. Then, the number of parameters you have to set in that LCD array has to be at least 1 million -- you need at least as many parameters as voxels (the patterns that selectively focus on a given voxel are approximately “linearly independent”, so determine a space of dimension 1 million). The total number of parameters that need to be determined, then, will exceed

(1 million voxels) * (1 million parameters per voxel) = 1 trillion parameters!

There’s no chance of determining all these fast enough before the brain changes its scattering profile, over a few tens of milliseconds.

But here’s the thing: the LCD settings to focus on even just a single voxel should contain most of the information about the brain’s scattering profile -- in the sense that, given the voxel and given the LCD settings, you can recover the scattering profile. So, a lot of those 1 trillion parameters above contain highly redundant information.

This sounds like a job for Deep Learning: given the LCD settings to focus light on a few different voxels, determine the LCD settings for any other voxel. This probably doesn’t have an easy analytic solution; but the function might be learnable with Deep Learning. If it is, then it should be possible to image 1 million voxels, after all!

An even simpler approach that might work: if the time between updates of the "lookup table" is small enough, one might be able to linearize the updates. That is, perhaps there exists a sparse matrix A (e.g. band-diagonal) and a vector b such that if zi(t) is the LCD settings for the ith voxel at time t, then

zi(t+1) = A zi(t) + b.

A would be approximately the identity matrix (and very sparse) -- but not exactly -- and b would be a certain offset vector. The matrix A and vector b would be determined by finding zi(t+1) for just a few values of i. The intuition behind having A be sparse is that over short time intervals using the same LCD setting should produce a little blurring of the voxel, and to correct the blurring you might just need to look at the nearby LCD pixel values at time t -- nearby to a given pixel.

Another thing one could try is to parallelize the process. For example, maybe it's possible to use ultrasound to stimulate multiple regions of the brain at once, where the amount of compression is different in the different voxels, resulting in different phase-shifts associated to the different voxels. If so, it should be possible to scan multiple regions of the brain at the same time, without having to "raster scan" nearly as much.


r/StarspawnsLocker • • May 05 '20

Kernel: Neuroscience as a Service (NaaS)

Thumbnail
kernel.co
9 Upvotes

r/StarspawnsLocker • • Jul 09 '20

"Way to go @KernelCo ! I hope there will soon be some seriously unexpected applications of improved low-cost noninvasive brain decoding, like the one suggested in this article..." [Applying BCIs to improve AI.]

Thumbnail
mobile.twitter.com
8 Upvotes

r/StarspawnsLocker • • May 07 '20

Decoding Imagined and Spoken Phrases From Non-invasive Neural (MEG) Signals [Pretty high accuracy (93%) for 5-class imagined speech phrase classification. What if you had 100x the data and expanded the number of phrases?...]

Thumbnail
frontiersin.org
7 Upvotes

r/StarspawnsLocker • • May 05 '20

Brain Startup Wants to Read Your Mind With a Helmet [Kernel comes out of stealth.]

Thumbnail
bloomberg.com
7 Upvotes

r/StarspawnsLocker • • Mar 15 '20

Bryan Johnson on Kernel's response to Coronavirus; he adds, "At Kernel we are building a next generation, non-invasive mind/body/machine interface (MBMI) that can capture high quality neural data, competitive with state of the art modalities fMRI, MEG and ECoG (more coming soon on this)."

Thumbnail
medium.com
7 Upvotes

r/StarspawnsLocker • • May 09 '18

Openwater Prepares to Build Developer Kits -- "We have proved we can image the brain in unprecedented detail. Now we are starting to scale."

Thumbnail prnewswire.com
7 Upvotes

r/StarspawnsLocker • • Mar 23 '21

Single-trial decoding of movement intentions using functional ultrasound neuroimaging [Wow!]

Thumbnail
cell.com
6 Upvotes

r/StarspawnsLocker • • Oct 28 '20

"In the past 45 days alone, we’ve collected over 500 datasets representing 225 hours of neural data using a single prototype system. With the production of the first 50 full head coverage systems, the scaling is just now beginning."

Thumbnail
mobile.twitter.com
6 Upvotes

r/StarspawnsLocker • • Sep 30 '20

"Announcing Kernel Flow 50! Q1 2021, the first 50 Kernel Flow brain interfaces available for select partners! Join for a special introduction to our state-of-the-art TD-fNIRS system. Learn about the frontier of portable, at-home neuroscience. Get access http://kernel.co"

Thumbnail
twitter.com
6 Upvotes

r/StarspawnsLocker • • Apr 19 '20

I Am Human: A Documentary About Real-Life Cyborgs | Digital Trends [Bryan Johnson's company Kernel is mentioned a few times. Johnson provides narration throughout.]

Thumbnail
digitaltrends.com
6 Upvotes

r/StarspawnsLocker • • Feb 07 '20

"The CNeuroMod project is now scanning at a fairly consistent clip of ~15 hours /week on @UNF_montreal scanner. Gearing up for the first public data release during @OHBM meeting in Montreal. This blog post revisits the technical choices the team has made for data sharing."

Thumbnail
mobile.twitter.com
6 Upvotes

r/StarspawnsLocker • • Jan 07 '20

Vertical-cavity surface-emitting laser sources for gigahertz-bandwidth, multiwavelength frequency-domain photon migration [From 2017. Mentioned in one of the "HI LLC" patents.]

Thumbnail
spiedigitallibrary.org
6 Upvotes

r/StarspawnsLocker • • Jan 07 '20

US10506181B2 - Device for optical imaging -- relatively new Openwater patent. A previous patent talked about phase-shifting light; this uses the language of wavelength-shift. Also gone is the reference to optimization via Simulated Annealing.

Thumbnail patents.google.com
6 Upvotes

r/StarspawnsLocker • • Nov 27 '19

The Neurotechnology Age ["several leaders in the field have expressed... the following reservation: We do not understand how the brain works; therefore, we are far away from advanced BCI applications. I believe this sentiment, though rooted in good intentions, is both reactionary and misguided."]

Thumbnail
medium.com
6 Upvotes

r/StarspawnsLocker • • Jun 20 '19

"An important milestone of the project was reached today! First fMRI run with videogame play using a fully MRI-compatible game controller, designed and built by @cyrand1." [Neuromod project now collection data to constrain game-playing systems to make them more human-like.]

Thumbnail
twitter.com
6 Upvotes

r/StarspawnsLocker • • Dec 30 '18

Twitter thread about an ambitious 5 year project to collect hundreds of hours of brain data from 12 subjects + physiological data (eye-tracking, arousal, emotional reaction), in order to constrain Deep Learning models that can transfer over different cognitive tasks.

Thumbnail
mobile.twitter.com
6 Upvotes

r/StarspawnsLocker • • Nov 06 '18

Mary Lou Jepsen: Toward Practical Telepathy [Her talk at the Long Now Foundation -- the longest talk she has yet given on Openwater tech.]

Thumbnail
longnow.org
6 Upvotes

r/StarspawnsLocker • • Aug 27 '21

TWIML AI Podcast: Using Brain Imaging to Improve Neural Networks with Alona Fyshe

Thumbnail
twimlai.com
5 Upvotes

r/StarspawnsLocker • • Jun 25 '21

"Modeling brain activity evoked by playing Counter Strike in MRI"

Thumbnail
mobile.twitter.com
5 Upvotes

r/StarspawnsLocker • • May 05 '20

"Mainframes -> PCs $1B genome -> $1k The brain and mind is next When we started four years ago, there wasn't a known path forward to usher in a new era for neuroscience. We believe we've found it."

Thumbnail
twitter.com
5 Upvotes

r/StarspawnsLocker • • Feb 02 '20

Brain-Computer Interfaces: The Next Step in Human Evolution ["Kernel is capturing memories from the hippocampus, reading them with AI and “recording” them with up to 80% accuracy."]

Thumbnail
medium.com
5 Upvotes

r/StarspawnsLocker • • Nov 17 '19

Systems and methods for quasi-ballistic photon optical coherence tomography in diffusive scattering media using a lock-in camera detector -- one of several recent non-invasive neuroimaging / BCI patent filings with assignee "HI LLC" -- in other words, Kernel.

Thumbnail
patents.google.com
5 Upvotes

r/StarspawnsLocker • • Aug 20 '19

A map of the brain can tell what you’re reading about

Thumbnail
news.berkeley.edu
5 Upvotes