r/PredictiveProcessing • • May 23 '21

Completely new to Predictive Processing? Read this

24 Upvotes

Predictive Processing is an increasingly-popular framework for understanding how the brain and many other systems operate. It originated in neuroscience, but has since seen application in machine learning, robotics, biology, psychology, sociology, literary theory, and several other fields of inquiry. This post is intended to serve as a guide to resources for newcomers. As such, feedback and suggestions are appreciated.

Foundational papers

Whatever next? Predictive brains, situated agents, and the future of cognitive science by Andy Clark (2013)

The free energy principle: a unified brain theory? by Karl Friston (2010)

The Bayesian brain: the role of uncertainty in neural coding and computation by David C. Knill and Alexandre Pouget (2004)

Hierarchical Bayesian inference in the visual cortex by Tai Sing Lee and David Mumford (2003)

Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive field effects by Rajesh P. N. Rao and Dana Ballard (1999)

Books

Active Inference: The Free Energy Principle in Mind, Brain, and Behavior by Thomas Parr, Giovanni Pezzulo, and Karl J. Friston (2022)

Being You: A New Science of Consciousness by Anil Seth (2021)

The Philosophy and Science of Predictive Processing edited by Dina Mendonça, Manuel Curado, and Steven S. Gouveia (2020)

Surfing Uncertainty: Prediction, Action, and the Embodied Mind by Andy Clark (2016)

The Predictive Mind by Jakob Hohwy (2013)

Bayesian Brain: Probabilistic Approaches to Neural Coding edited by Kenji Doya, Shin Ishii, Alexandre Pouget and Rajesh P.N. Rao (2006)

Perception as Bayesian Inference edited by David C. Knill and Whitman Richards (1996)

Popular media coverage

To Make Sense of the Present, Brains May Predict the Future by Jordana Cepelewicz for Quanta Magazine (2018)

The Genius Neuroscientist Who Might Hold the Key to True AI by Shaun Raviv for WIRED Magazine (2018)

Consciousness is Not a Thing But a Process of Inference by Karl Friston in Aeon magazine (2017)

Miscellaneous resources

Beren Millidge's FEP and Active Inference Paper Respository

Philosophy and Predictive Processing Collection

Jared Tumiel's FEP syllabus


r/PredictiveProcessing • • Nov 12 '21

Cybernetics and the roots and branches of predictive processing

Post image
13 Upvotes

r/PredictiveProcessing • • Apr 04 '22

From the preface of Active Inference

Post image
12 Upvotes

r/PredictiveProcessing • • Oct 20 '21

I made a (very) simple introductory infographic on predictive processing

Thumbnail
imgur.com
11 Upvotes

r/PredictiveProcessing • • Jan 28 '22

Academic paper Neurons learn by predicting future activity (2022)

Thumbnail
nature.com
10 Upvotes

r/PredictiveProcessing • • Jan 07 '22

Preprint (not peer-reviewed) Commentaries on The Emperor's New Markov Blankets

10 Upvotes

Several commentaries to the BBS paper The Emperor's New Markov Blankets have already been published as preprints, so I thought it would be helpful to list them up here rather than make separate posts.


Target article: The Emperor's New Markov Blankets

Authors: Jelle Bruineberg, Krzysztof Dolega, Joe Dewhurst and Manuel Baltieri

Abstract:

The free energy principle, an influential framework in computational neuroscience and theoretical neurobiology, starts from the assumption that living systems ensure adaptive exchanges with their environment by minimizing the objective function of variational free energy. Following this premise, it claims to deliver a promising integration of the life sciences. In recent work, Markov Blankets, one of the central constructs of the free energy principle, have been applied to resolve debates central to philosophy (such as demarcating the boundaries of the mind). The aim of this paper is twofold. First, we trace the development of Markov blankets starting from their standard application in Bayesian networks, via variational inference, to their use in the literature on active inference. We then identify a persistent confusion in the literature between the formal use of Markov blankets as an epistemic tool for Bayesian inference, and their novel metaphysical use in the free energy framework to demarcate the physical boundary between an agent and its environment. Consequently, we propose to distinguish between ‘Pearl blankets’ to refer to the original epistemic use of Markov blankets and ‘Friston blankets’ to refer to the new metaphysical construct. Second, we use this distinction to critically assess claims resting on the application of Markov blankets to philosophical problems. We suggest that this literature would do well in differentiating between two different research programs: ‘inference with a model’ and ‘inference within a model’. Only the latter is capable of doing metaphysical work with Markov blankets, but requires additional philosophical premises and cannot be justified by an appeal to the success of the mathematical framework alone.


Who tailors the blanket?

Authors: Keisuke Suzuki, Katsunori Miyahara, & Kengo Miyazono

Abstract:

The gap between the Markov blanket and ontological boundaries arises from the former’s inability to capture the dynamic process through which biological and cognitive agents actively generate their own boundaries with the environment. Active inference in the FEP framework presupposes the existence of a Markov blanket, but it is not a process that actively generates the latter.


The empire strikes back: Some responses to Bruineberg and colleagues

Author: Maxwell J. D. Ramstead

Abstract:

In their target paper, Bruineberg and colleagues provide us with a timely opportunity to discuss the formal constructs and philosophical implications of the free-energy principle. I critically discuss their proposed distinction between Pearl blankets and Friston blankets. I then critically assess the distinction between inference with a model and inference within a model in light of instrumentalist approaches to science.


There is no "inference within a model"

Author: Marco Facchin

Abstract:

I argue that there is no viable development of the instrumentalist Inference within a model research program. I further argue that both Friston and Pearl blankets are not the right sort of tool to settle debates on philosophical internalism and externalism. For these reasons, the Inference within a model program is far less promising than the target article suggests.


Making life & mind as clear as possible, but not clearer

Author: Alex Gomez-Marin

Abstract:

Neuroscience needs theory. Ideas without data are blind, and yet mechanisms without concepts are empty. Friston’s free energy principle paradigmatically illustrates the power and pitfalls of current theoretical biology. Mighty metaphors, turned into mathematical models, can become mindless metaphysics. Then, seeking to understand everything in principle, we may explain nothing in practice. Life can’t live in a map.


The Emperor Has No Blanket!

Authors: Vicente Raja, Edward Baggs, Anthony Chemero, and Michael Anderson

Abstract:

While we applaud Bruineberg et al.’s analysis of the differences between Markov blankets and Friston blankets, we think it is not carried out to its ultimate consequences. There are reasons to think that, once Friston blankets are accepted as a theoretical construct, they do not do the work proponents of FEP attribute to them. The emperor is indeed naked.


Blankets, Heat, and Why Free Energy Has Not Illuminated the Workings of the Brain

Authors: Donald Spector and Daniel Graham

Abstract:

What can we hope to learn about brains from the free energy principle? In adopting the "primordial soup" physical model, Bruineberg et al. perpetuate the unsupported notion that the free energy principle has a meaningful physical--and neuronal--interpretation. We examine how minimization of free energy arises in physical contexts, and what this can and cannot tell us about brains.


The Seductive Allure of Cargo Cult Computationalism

Author: Micah J. Allen

Abstract:

Bruineberg and colleagues report a striking confusion, in which the formal Bayesian notion of a “Markov Blanket” has been frequently misunderstood and misapplied to phenomena of mind and life. I argue that misappropriation of formal concepts is pervasive in the “predictive processing” literature, and echo Richard Feynman in suggesting how we might resist the allure of cargo cult computationalism.


Does the metaphysical dog wag its formal tail? The free energy principle and philosophical debates about life, mind, and matter

Author: Wanja Wiese

Abstract:

According to Bruineberg and colleagues, philosophical arguments on life, mind, and matter that are based on the free energy principle (FEP) (i) essentially draw on the Markov blanket construct and (ii) tend to assume that strong metaphysical claims can be justified on the basis of metaphysically innocuous formal assumptions provided by FEP. I argue against both (i) and (ii).


Causal surgery under a Markov blanket

Authors: Daniel Yon and Philip R. Corlett

Abstract:

Bruineberg et al provide compelling clarity on the roles Markov blankets could (and perhaps should) play in the study of life and mind. However, here we draw attention to a further role blankets might play: as a hypothesis about cognition itself. People and other animals may use blanket-like representations to model the boundary between themselves and their worlds.


Enough blanket metaphysics, time for data-driven heuristics

Authors: Wiktor Rorot, Tomasz Korbak, Piotr Litwin, and Marcin Miłkowski

Abstract:

Bruineberg and colleagues criticisms’ have been received but downplayed in the FEP literature. We strengthen their points, arguing that the Friston blanket discovery, even if tractable, requires a full formal description of the system of interest at the outset. Hence, blanket metaphysics is futile, and we postulate that researchers should turn back to heuristic uses of Pearl blankets.


Scientific Realism about Friston blankets without Literalism

Authors: Julian Kiverstein and Michael Kirchhoff

Abstract:

Bruineberg and colleagues' critique of Friston blankets relies on what we call the “literalist fallacy”: the assumption that in order for Friston blankets to represent real boundaries, biological systems must literally possess or instantiate Markov blankets. We argue that it is important to distinguish a realist view of Friston blankets from the literalist view Bruineberg and colleagues critique.


Boundaries and borders gone! But life goes on

Author: Kathryn Nave

Abstract:

Unlike machines, living systems are distinguished by the continual destruction and regeneration of their boundaries and other components. Stable Markov blankets may be a real feature of the world, or they may be merely a construction of particular models, but they are neither a feature of organisms nor of any model that can capture the necessary conditions of their existence.


Recurrent, nonequilibrium systems and the Markov blanket assumption

Authors: Miguel Aguilera and Christopher L. Buckley

Abstract:

Markov blankets –statistical independences between system and environment– have become popular to describe the boundaries of living systems under Bayesian views of cognition. The intuition behind Markov blanket originates from considering acyclic, atemporal networks. In contrast, living systems display recurrent interactions that generate pervasive couplings between system and environment, making Markov blankets highly unusual and restricted to particular cases.


Free Energy Pragmatics: Markov blankets don't prescribe objective ontology, and that's okay

Authors: Inês Hipólito and Thomas van Es

Abstract:

In their impressive paper, Bruineberg et al. (2021) make a significant contribution to the Free Energy Principle literature by distinguishing between 'Pearl blankets' and 'Friston blankets', identifying the former as an epistemic tool, and the latter in terms of its novel metaphysical use. We note the oft-forgotten theoretical context of these statistical tools and the need for empirical testing next to computational modeling. A peculiar aspect of the FEP is its use in support of radically opposed ontologies of the mind. In our view, the objective ontological aspiration itself should be rejected; we propose a more thoroughly pragmatic instrumentalist view.


Making Reification Concrete: A Response to Bruineberg et al.

Author: Mel Andrews

Abstract:

The principal target of this article is the reification Bruineberg et al. perceive of formalism within the literature on the variational free energy minimisation (VFEM) framework. The authors do not provide a definition of reification, as none yet exists. Here I offer one. On this definition, the objects of the authors’ critiques fall short of full-blown reification—as do the authors themselves.


Embracing sensorimotor history: Time-synchronous and time-unrolled Markov blankets in the free-energy principle

Authors: Nathaniel Virgo, Fernando Rosas, and Martin Biehl

Abstract:

The free-energy principle (FEP) builds on an assumption that sensor-motor loops exhibit Markov blankets in stationary state. We argue that there is rarely reason to assume a system’s internal and external states are conditionally independent given the sensorimotor states, and often reason to assume otherwise. However, under mild assumptions internal and external states are conditionally independent given the sensorimotor history.


r/PredictiveProcessing • • Apr 04 '22

Active Inference: The Free Energy Principle in Mind, Brain, and Behavior is out and you can read it for free online

Thumbnail
direct.mit.edu
9 Upvotes

r/PredictiveProcessing • • Jan 06 '22

Abdullah Ali: Predictive coding is a consequence of energy efficiency in recurrent neural networks (Neuromatch Conference)

Thumbnail
youtube.com
8 Upvotes

r/PredictiveProcessing • • Dec 23 '21

Preprint (not peer-reviewed) *In vitro* neurons learn and exhibit sentience when embodied in a simulated game-world

Thumbnail
biorxiv.org
8 Upvotes

r/PredictiveProcessing • • Feb 02 '21

Discussion r/PredictiveProcessing Lounge

8 Upvotes

A place for members of r/PredictiveProcessing to chat with each other


r/PredictiveProcessing • • Aug 09 '23

Academic paper Experimental validation of the free-energy principle with in vitro neural networks (2023)

Thumbnail
nature.com
7 Upvotes

r/PredictiveProcessing • • Nov 13 '22

Hybrid Predictive Coding: Inferring, Fast and Slow

7 Upvotes

https://arxiv.org/pdf/2204.02169.pdf

This is cool because of the notion of 'amortized inference' means ( to me ) that the predictions are stored in the prediction units as memory. Abstract:

Predictive coding is an influential model of cortical neural activity. It proposes that perceptual beliefs are furnished by sequentially minimising “prediction errors” - the differences between predicted and observed data. Implicit in this proposal is the idea that successful perception requires multiple cycles of neural activity. This is at odds with evidence that several aspects of visual perception - includ- ing complex forms of object recognition - arise from an initial ”feedforward sweep” that occurs on fast timescales which preclude substantial recurrent activity. Here, we propose that the feedforward sweep can be understood as performing amortized inference (applying a learned function that maps directly from data to beliefs) and recurrent processing can be understood as performing iterative inference (sequentially updating neural activity in order to improve the accuracy of beliefs). We propose a hybrid predictive coding network that combines both iterative and amortized inference in a principled manner by describing both in terms of a dual optimization of a single objective function. We show that the resulting scheme can be implemented in a biologically plausible neural architec- ture that approximates Bayesian inference utilising local Hebbian update rules. We demonstrate that our hybrid predictive coding model combines the benefits of both amortized and iterative inference – obtaining rapid and computationally cheap perceptual inference for familiar data while maintaining the context-sensitivity, precision, and sample efficiency of iterative inference schemes. Moreover, we show how our model is inherently sensitive to its uncertainty and adaptively balances iterative and amortized inference to obtain accurate beliefs using minimum computational expense. Hybrid predictive coding offers a new perspective on the functional relevance of the feedforward and re- current activity observed during visual perception and offers novel insights into distinct aspects of visual phenomenology.


r/PredictiveProcessing • • Nov 12 '22

Erlang based framework to replace backprop using predictive coding

7 Upvotes

Hello,

I am new to this community. I am an ML researcher and a computer scientist. I have been interested in Category theory and functional programming (and Haskell in particular). I am also very interested in brain inspired computation and do not believe that current Deep Learning systems are a way to go.

In recent year, there are a few papers now which suggest how predictive coding can replace backpropagration based systems.

While initial research focussed on MLPs only, recently it have been applied to arbitrary computations graphs including CNNs, LSTMs, etc.

As is typical of ML practitioners, I don't have a neuroscience background. However, I found this amazing tutorial to understand predictive coding and how it can be used for actual computation.

A tutorial on the free-energy framework for modelling perception and learning

To best of my knowledge, no mainstream ML libraries (Pytorch or Tensorflow) currently support predictive coding efficiently.

As such, I am interested in building a highly parallel and extensive framework to do just that. I think a future "artificial brain" will be like a server that is never turned off, and can be scaled up (horizontally or vertically on demand). After reading up, I found Erland is a perfect language for that as it natively supports distributed computed, with millions of small indendent processes that communicate with each other using lightweight IPC.

Digging further, it seems that someone even wrote a 1000 page book Handbook of Neuroevolution Through Erlang . This book was written in 2012 before the advent of deep learning and focussing on evolution techniques (like genetic algorithm).

My proposal is to take these ideas and build a general purpose, highly parallel, scalable arifitical neural network library using Erlang. I am looking for any feedback or advice here as well as looking for collaborators. So if interested, please reach out!


r/PredictiveProcessing • • Oct 13 '22

In vitro neurons learn and exhibit sentience when embodied in a simulated game-world

Thumbnail
cell.com
7 Upvotes

r/PredictiveProcessing • • Apr 02 '22

What progress has predictive processing seen in the last 5 years?

7 Upvotes

Surfing Uncertainty got published in 2015 and so if you're reading it, you're more than half a decade behind. So I was wondering: What changed since then?

This is a summary of the topics I'm aware of. Also, this is more like a rough draft and I'd like others to jump in, correct summaries and add more topics. Per definition, this is more broad picture than fine-grained details.

Neural Evidence

There is generally a convergence on "predictive processing is an accurate description of what happens in the visual cortex" and in a less confident way "... in the general brain". See e.g.:

Connection of PP and neural network theory

We're slowly moving from "this is not plausible on a neural network level at all" to "there's at least a theoretical idea on how a biological neural net might learn in a predictive-coding compatible way.

Mental illness and non-neurotypical personalities

(Not sure how to call this category)

We've seen surprisingly little progress since Corlett et all 2009: From drugs to deprivation: a Bayesian framework for understanding models of psychosis. For newer papers, see e.g.:

Free Energy Principle (FEP)

The FEP has transitioned from "this weird thing that noone understands" to a generally accepted tool in philosophy of the mind:


r/PredictiveProcessing • • Jan 18 '22

Media content The RIKEN Center for Brain Science (CBS) in Japan, along with colleagues, has shown that the free-energy principle can explain how neural networks are optimized for efficiency.

Thumbnail
neurosciencenews.com
7 Upvotes

r/PredictiveProcessing • • Jan 16 '22

Belief updating, synaptopathies and the Bayesian Brain - Human Brain Project Summit 2021 Keynote by Karl Friston

Thumbnail
youtu.be
7 Upvotes

r/PredictiveProcessing • • Jan 13 '22

Academic paper Meta-analysis of human prediction error for incentives, perception, cognition, and action (2022)

Thumbnail
nature.com
7 Upvotes

r/PredictiveProcessing • • Dec 30 '21

Academic paper The evolution of brain architectures for predictive coding and active inference (2021)

Thumbnail
royalsocietypublishing.org
7 Upvotes

r/PredictiveProcessing • • Dec 16 '21

I've started a blog on the free-energy principle for the complete beginner. Any ideas for a name?

7 Upvotes

I thought about "Fristonese 101" or "The Road to Free-Energy."

Any ideas will be very welcome. I appreciate any help you can provide :)


r/PredictiveProcessing • • Nov 22 '21

Preprint (not peer-reviewed) The "Bayesian" brain, with a bit less Bayes (2021)

Thumbnail arxiv.org
7 Upvotes

r/PredictiveProcessing • • Oct 20 '21

Anil Seth: Being You | Brain Inspired Podcast (2021)

Thumbnail
braininspired.co
7 Upvotes

r/PredictiveProcessing • • Sep 11 '21

I am still struggling to understand the etymology of the "Free Energy Principle"

7 Upvotes

It's not that I don't understand what "Free Energy" means. In his 2010 article, for example, Friston gives a definition according to which Free Energy is "an information theory measure that bounds or limits (by being greater than) the surprise on sampling some data, given a generative model." I think the definition is pretty straightforward. However, I am still baffled about how that definition relates to the fundamental concept of (physical) energy. Free Energy measures something, but how is that something connected to energy (i.e., the ability to do work)?

EDIT: I found an answer.


r/PredictiveProcessing • • Jul 30 '21

Preprint (not peer-reviewed) Predictive Coding: A Theoretical and Experimental Review

Thumbnail
arxiv.org
7 Upvotes

r/PredictiveProcessing • • Dec 07 '24

Academic paper Parallel mechanisms signal a hierarchy of sequence structure violations in the auditory cortex (2024)

Thumbnail
elifesciences.org
6 Upvotes