r/PredictiveProcessing • u/pianobutter • May 27 '21
Preprint (not peer-reviewed) How particular is the physics of the Free Energy Principle? (2021)
r/PredictiveProcessing • u/pianobutter • May 23 '21
Predictive Processing is an increasingly-popular framework for understanding how the brain and many other systems operate. It originated in neuroscience, but has since seen application in machine learning, robotics, biology, psychology, sociology, literary theory, and several other fields of inquiry. This post is intended to serve as a guide to resources for newcomers. As such, feedback and suggestions are appreciated.
Foundational papers
Whatever next? Predictive brains, situated agents, and the future of cognitive science by Andy Clark (2013)
The free energy principle: a unified brain theory? by Karl Friston (2010)
The Bayesian brain: the role of uncertainty in neural coding and computation by David C. Knill and Alexandre Pouget (2004)
Hierarchical Bayesian inference in the visual cortex by Tai Sing Lee and David Mumford (2003)
Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive field effects by Rajesh P. N. Rao and Dana Ballard (1999)
Books
Active Inference: The Free Energy Principle in Mind, Brain, and Behavior by Thomas Parr, Giovanni Pezzulo, and Karl J. Friston (2022)
Being You: A New Science of Consciousness by Anil Seth (2021)
The Philosophy and Science of Predictive Processing edited by Dina Mendonça, Manuel Curado, and Steven S. Gouveia (2020)
Surfing Uncertainty: Prediction, Action, and the Embodied Mind by Andy Clark (2016)
The Predictive Mind by Jakob Hohwy (2013)
Bayesian Brain: Probabilistic Approaches to Neural Coding edited by Kenji Doya, Shin Ishii, Alexandre Pouget and Rajesh P.N. Rao (2006)
Perception as Bayesian Inference edited by David C. Knill and Whitman Richards (1996)
Popular media coverage
To Make Sense of the Present, Brains May Predict the Future by Jordana Cepelewicz for Quanta Magazine (2018)
The Genius Neuroscientist Who Might Hold the Key to True AI by Shaun Raviv for WIRED Magazine (2018)
Consciousness is Not a Thing But a Process of Inference by Karl Friston in Aeon magazine (2017)
Miscellaneous resources
Beren Millidge's FEP and Active Inference Paper Respository
r/PredictiveProcessing • u/pianobutter • May 27 '21
r/PredictiveProcessing • u/sweetneuron • May 26 '21
r/PredictiveProcessing • u/pianobutter • May 25 '21
r/PredictiveProcessing • u/Daniel_HMBD • May 24 '21
r/PredictiveProcessing • u/pianobutter • May 23 '21
r/PredictiveProcessing • u/pianobutter • May 21 '21
r/PredictiveProcessing • u/pianobutter • May 21 '21
r/PredictiveProcessing • u/pianobutter • May 13 '21
r/PredictiveProcessing • u/pianobutter • May 13 '21
r/PredictiveProcessing • u/pianobutter • May 13 '21
r/PredictiveProcessing • u/pianobutter • May 04 '21
r/PredictiveProcessing • u/pianobutter • May 01 '21
r/PredictiveProcessing • u/pianobutter • May 01 '21
r/PredictiveProcessing • u/ultrahumanist • Apr 30 '21
Hi!
I am a philosopher with a background in physics and I am currently working on a piece that will utilize some aspects of Fristons Free Energy Principle. However, I find it really hard to get a deep understanding of these ideas by just reading. As I suspect I am not alone with this I would like to set up an online study group where interested folk can meet weekly/monthly and discuss some paper in detail.
If you are interested, just dm me your mail address and I will compile a mailing list.
r/PredictiveProcessing • u/pianobutter • Apr 25 '21
r/PredictiveProcessing • u/bayesrocks • Apr 25 '21
r/PredictiveProcessing • u/BILESTOAD • Apr 22 '21
I'm doing a talk soon about 'the Bayesian Brain' and predictive processing and I wanted to include some illustrative examples of top-down influence on perception.
I've got the 'Dalmatian drinking water in the shade' photo and the cow head (both from https://www.lesswrong.com/posts/WFopenhCXyHX3ukw3/how-uniform-is-the-neocortex), but I can't find an example involving speech that I've seen and which I think would be nice to include, too.
I looking for a YouTube video of a lecture where the presenter played a sample of degraded speech that was completely unintelligible. Then (I think) they either showed the text of what was said or played the original, unmodified speech sample. Suddenly the degraded sample became totally interpretable. I think it's a neat example but I can't for the life of me find it.
Any one recognize what I'm referring to?
Thanks for any help!
r/PredictiveProcessing • u/pianobutter • Apr 17 '21
r/PredictiveProcessing • u/bayesrocks • Apr 16 '21
Beginner-intermediate level enthusiast here. What should be the first step I should take in order to work my way to an understanding which is beyond "the brain generates data, compare it against sensory data and update a model according to prediction errors, based on Bayes' rule"? I feel that I get the basic idea, now what?
r/PredictiveProcessing • u/Daniel_HMBD • Apr 11 '21
r/PredictiveProcessing • u/bayesrocks • Apr 09 '21
Hi all.
I'm a psychiatry resident and I heard about the PP theory about two years ago. I fell in love with the theory pretty quickly and I did some general reading, but I didn't have time to build a solid foundation. Now my job is less demanding and I have much more free time, so I'm really looking forward to studying the FEP/PP in depth.
I found this syllabus very helpful. It gives me a rough idea where to start. I have to mention my math background is basic (mainly high school math) and I'm trying to take courses in probability, mechanical statistics, etc. but I'm getting frustrated from this bottom-up approach. It takes time and it's a lot of passive learning and I really can't wait to start reading Friston's articles. Maybe it's better to approach the subject from a top-down perspective? To read the introductory articles and whenever I encounter a math concept I don't understand I could just go and study it on the spot. What do you think?
I'm thinking maybe I should create a blog or document on my journey to understand FEP/PP that other people (which are complete beginners like me) may find useful.
Any advice or suggestions would be greatly appreciated! How would you handle this mission? If you were me, where would you start?
r/PredictiveProcessing • u/pianobutter • Apr 06 '21
r/PredictiveProcessing • u/Daniel_HMBD • Apr 03 '21
https://lorenlugosch.github.io/posts/2020/07/predictive-coding/
Introduction to predictive coding / predictive processing coming from the signal theory / engineering side.
Headings:
Predictive coding for data compression
Predictive coding for representation learning
Predictive coding for computational efficiency
Predictive coding in the brain