The Physics of Emergence

We should expect that concrete intelligent systems will arise through dynamical optimization and selection processes. A priori, it’s quite surprising that many of the simple dynamics that we see at play in nature and in AI training would be able to find any of the complex structures that we observe or hypothesize.

Ideas from different parts of physics (statistical mechanics, non-equilibrium thermodynamics, etc.) as well as the general study of complex systems can help shed light on some of what is happening here. Singular Learning Theory (SLT) and the Free Energy Principle (FEP) take this approach.

Status: Active

Linked Posts:

• Notes on Active Inference