Uploaded August 2026 | Updated November 2026, 12 hours ago
Book: Fundamentals of Active Inference
Principles, Algorithms, and Applications of the Free Energy Principle for Engineers, by Sanjeev V. Namjoshi https://mitpress.mit.edu/9780262050951/fundamentals-of-active-inference/
Register: http://textbook-group.activeinference.institute/
Code: github.com/ActiveInferenceInstitute/fundamentals
Playlist of Textbook Group: youtube.com/playlist?list=PLNm0u2n1IwdrpoTg-9l37YIBiDrrOzTw-
Direct link to group document: coda.io/d/_dZHp_UGhVZE/Meetings_su3ToqMp
------
Active Inference Institute information:
Website: https://activeinference.institute/
X: https://x.com/InferenceActive
Discord: https://discord.activeinference.institute/
Donate: https://donate.activeinference.institute/
YouTube: youtube.com/c/ActiveInference
Active Inference Livestreams: https://video.activeinference.institute/
------
CHAPTERS
0:00 Welcome; second week on Chapter 8
1:30 Recap of the previous session
3:00 Where to find the code
4:30 Translating equations into code
6:00 Precision-weighted prediction errors
7:30 Perception, learning and attention: three time scales
10:30 Action and inverting the model
12:00 Precision-weighted errors in the update equations
13:30 Errata found by the group
15:00 Algorithm 12 step by step
16:30 Predicting observations from the model
18:00 Zero indexing in code
19:30 Erratum: x* in the state transition function
22:30 What Algorithm 12 leaves out
24:00 Hidden states, parameters and precisions
25:30 Initializing and recording variables
27:00 Algorithm 13: the full algorithm
30:00 Recomputing errors with new predictions
31:30 Generalized coordinates: flows of flows
33:00 Excitatory and inhibitory messages between neurons
34:30 Normative models vs. top performance
36:00 The most advanced continuous-state algorithm in the book
37:30 Nested loops across layers
39:00 Nonlinear generative processes
42:00 Libraries: SPM, pymdp, RxInfer, ActiveInference.jl
45:00 Algorithm 13 as the basis for a library
48:00 Walkthrough: Algorithm 12 in a notebook
49:30 Priors, generating functions and learning rates
51:00 The environment function
54:00 Generating and state transition functions
57:00 Partial derivatives for each update
58:30 Running the full simulation
1:00:00 The group questions page
1:01:30 Preview: discrete states in Chapter 9
Book: Fundamentals of Active Inference
Principles, Algorithms, and Applications of the Free Energy Principle for Engineers, by Sanjeev V. Namjoshi https://mitpress.mit.edu/9780262050951/fundamentals-of-active-inference/
Register: http://textbook-group.activeinference.institute/
Code: github.com/ActiveInferenceInstitute/fundamentals
Playlist of Textbook Group: youtube.com/playlist?list=PLNm0u2n1IwdrpoTg-9l37YIBiDrrOzTw-
Direct link to group document: coda.io/d/_dZHp_UGhVZE/Meetings_su3ToqMp
------
Active Inference Institute information:
Website: https://activeinference.institute/
X: https://x.com/InferenceActive
Discord: https://discord.activeinference.institute/
Donate: https://donate.activeinference.institute/
YouTube: youtube.com/c/ActiveInference
Active Inference Livestreams: https://video.activeinference.institute/
------
CHAPTERS
0:00 Welcome; second week on Chapter 8
1:30 Recap of the previous session
3:00 Where to find the code
4:30 Translating equations into code
6:00 Precision-weighted prediction errors
7:30 Perception, learning and attention: three time scales
10:30 Action and inverting the model
12:00 Precision-weighted errors in the update equations
13:30 Errata found by the group
15:00 Algorithm 12 step by step
16:30 Predicting observations from the model
18:00 Zero indexing in code
19:30 Erratum: x* in the state transition function
22:30 What Algorithm 12 leaves out
24:00 Hidden states, parameters and precisions
25:30 Initializing and recording variables
27:00 Algorithm 13: the full algorithm
30:00 Recomputing errors with new predictions
31:30 Generalized coordinates: flows of flows
33:00 Excitatory and inhibitory messages between neurons
34:30 Normative models vs. top performance
36:00 The most advanced continuous-state algorithm in the book
37:30 Nested loops across layers
39:00 Nonlinear generative processes
42:00 Libraries: SPM, pymdp, RxInfer, ActiveInference.jl
45:00 Algorithm 13 as the basis for a library
48:00 Walkthrough: Algorithm 12 in a notebook
49:30 Priors, generating functions and learning rates
51:00 The environment function
54:00 Generating and state transition functions
57:00 Partial derivatives for each update
58:30 Running the full simulation
1:00:00 The group questions page
1:01:30 Preview: discrete states in Chapter 9
![ActInf GuestStream 131.1: Causal Architecture Dynamics Prior to Arrival of Self (Pigozzi and Levin)
Causal Architecture Dynamics Prior to Arrival of Self-replicators in a Model of Catalytic Networks Relevant to Origin-of-Life
Federico Pigozzi, Michael Levin
https://arxiv.org/abs/2607.28250
Agents that exert causal power in the world are thought to be the product of selection among diverse replicators; what is the causal structure of a medium before replicators appear, and evolution takes hold? We studied information-theoretic dynamics of the popular GARD model that captures several dynamics thought to be important at lifes origin and found that causal emergence predicted the initial appearance of self-replication. Moreover, interventions that drove causal emergence up increased the longevity of self-replicators, while interventions that drove causal emergence down decreased the abundance of these self-replicators, suggesting causal emergence as a functional control knob. Thus, progressive increases in integrated causality are detectable in active media before evolutionary dynamics begin to operate, which may have implications for the origin of life across highly diverse scenarios and for understanding the forces driving the rise in causal power observed in the biosphere on Earth.
[Submitted on 30 Jul 2026]
arXiv:2607.28250 [q-bio.PE]
(or arXiv:2607.28250v1 [q-bio.PE] for this version)
https://doi.org/10.48550/arXiv.2607.28250
Focus to learn more
Active Inference Institute information:
Website: https://www.activeinference.institute/
Activities: https://activities.activeinference.institute/
Discord: https://discord.activeinference.institute/
Donate: http://donate.activeinference.institute/
YouTube: https://www.youtube.com/c/ActiveInference/
X: https://x.com/InferenceActive
Active Inference Livestreams: https://video.activeinference.institute/ ActInf GuestStream 131.1: Causal Architecture Dynamics Prior to Arrival of Self (Pigozzi and Levin)](https://i.ytimg.com/vi/onxrJkX5xrY/mqdefault.jpg)



![ActInf ModelStream 019.1: Active Inference in Discrete State Spaces from First Principles (P. Kenny)
Active Inference in Discrete State Spaces from First Principles
Patrick Kenny
https://arxiv.org/abs/2511.20321
We seek to clarify the concept of active inference by disentangling it from the Free Energy Principle. We show how the optimizations that need to be carried out in order to implement active inference in discrete state spaces can be formulated as constrained divergence minimization problems which can be solved by standard mean field methods that do not appeal to the idea of expected free energy. When it is used to model perception, the perception/action divergence criterion that we propose coincides with variational free energy. When it is used to model action, it differs from an expected free energy functional by an entropy regularizer.
[Submitted on 25 Nov 2025 (v1), last revised 10 Dec 2025 (this version, v2)]
Cite as: arXiv:2511.20321 [cs.AI]
(or arXiv:2511.20321v2 [cs.AI] for this version)
https://doi.org/10.48550/arXiv.2511.20321
Active Inference Institute information:
Website: https://www.activeinference.institute/
Activities: https://activities.activeinference.institute/
Discord: https://discord.activeinference.institute/
Donate: http://donate.activeinference.institute/
YouTube: https://www.youtube.com/c/ActiveInference/
X: https://x.com/InferenceActive
Active Inference Livestreams: https://video.activeinference.institute/
CHAPTERS
0:00 Welcome and introductions
1:30 Active inference from first principles
3:00 Prediction and a KL divergence criterion
4:30 Intractable target distributions
6:00 The mean field approximation
7:30 Clamping observed variables
9:00 Hidden and observable variables
10:30 Variational free energy
12:00 Prediction horizon and hidden sequences
13:30 Approximating the posterior over the future
15:00 Constraints from the hidden Markov model
16:30 Standard update formulas
18:00 Retrodiction: updating past states
19:30 Predictive distributions for future observations
21:00 Connection to the free energy principle
22:30 From joint to marginal divergence
24:00 Comparison with expected free energy
25:30 Entropy regularization
27:00 Dropping the independence assumption
28:30 A subtle difference from the FEP
30:00 Learning HMM parameters
31:30 Posterior inference from past observations
33:00 Summary of the three problems
34:30 Mean field updates and convergence
36:00 Conclusion
37:30 Discussion: writing the free energy
40:30 Discussion: forms of the functionals
42:00 Discussion: conditional effects of actions
43:30 Folding actions and policies into HMM states
46:30 Dynamic approximating distributions
48:00 Action and perception as divergence minimization
49:30 Factorized approximations explained
51:00 Past clamped, future open
52:30 Fixed points of the objective
55:30 Entropies of emission distributions
57:00 Clarifying the KL divergences
1:00:00 Derivations in the appendix
1:01:30 Mean field and model adequacy
1:04:30 A discrete HMM at the center
1:06:00 Reflections on the paper
1:07:30 Motivations for the work
1:09:00 Debugging variational algorithms
1:10:30 Divergences and non-divergences
1:12:00 Continuous time and step sizes
1:15:00 From in silico to wetware
1:18:00 Continuous-state models
1:21:00 Random fluctuations across coordinates
1:22:30 Expected free energy: conventional vs. proposed
1:25:30 Free energy of the expected future
1:27:00 The physics of the free energy principle
1:28:30 Deriving policy priors
1:31:30 Habits and policy priors
1:33:00 Passive observers vs. agents
1:36:00 Convergence across approaches
1:37:30 Policies without explicit encoding
1:40:30 Deliberate action
1:43:30 Agent and niche
1:45:00 Predicting actions via sensations
1:48:00 The lowest levels of active inference models
1:49:30 One generative model for everything?
1:51:00 Closing ActInf ModelStream 019.1: Active Inference in Discrete State Spaces from First Principles (P. Kenny)](https://i.ytimg.com/vi/q6Z-4aXO36U/mqdefault.jpg)





