Discover and read the best of Twitter Threads about #freeenergyprinciple
Most recents (1)
ChatGPT is useful but is not a good model for human-like reasoning, since it needs a large training data set and consumes lots of energy. A thread on how far we are away from brain-inspired autonomous agents that, like humans, go out in the world and learn purposeful behavior.
The 1st step is to accept Bayesian (probabilistic) reasoning as the gold standard for reliable information processing. Yet, the adoption of Bayesian reasoning proceeds slowly in many relevant engineering fields such as signal processing and machine learning.
The 2nd step drops the utility theory cap on top of Bayesian reasoning, which is still a strong anchor in reinforcement learning and optimal control theory. Agents that act solely to maximize expected future utility will fail in several ways (see t.ly/GepB).
