<p>Intelligent algorithms developed evolutionarily within neural systems are considered in this work. Mathematical analyses unveil a triple equivalence between canonical neural networks, variational Bayesian inference under a class of partially observable Markov decision processes, and differentiable Turing machines, by showing that they minimise the shared Helmholtz energy. Consequently, canonical neural networks can biologically plausibly perform variational Bayesian inferences of external Turing machines. Applying Helmholtz energy minimisation at the species level facilitates deriving active Bayesian model selection inherent in natural selection, resulting in the emergence of adaptive algorithms. Canonical neural networks with two mental actions can form a universal machine by separately memorising transition mappings of multiple external Turing machines. These propositions are corroborated by numerical simulations of algorithm implementation and neural network evolution. These notions offer a universal characterisation of biological intelligence emerging from evolution in terms of Bayesian model selection and belief updating.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Triple equivalence for the emergence of biological intelligence

  • Takuya Isomura

摘要

Intelligent algorithms developed evolutionarily within neural systems are considered in this work. Mathematical analyses unveil a triple equivalence between canonical neural networks, variational Bayesian inference under a class of partially observable Markov decision processes, and differentiable Turing machines, by showing that they minimise the shared Helmholtz energy. Consequently, canonical neural networks can biologically plausibly perform variational Bayesian inferences of external Turing machines. Applying Helmholtz energy minimisation at the species level facilitates deriving active Bayesian model selection inherent in natural selection, resulting in the emergence of adaptive algorithms. Canonical neural networks with two mental actions can form a universal machine by separately memorising transition mappings of multiple external Turing machines. These propositions are corroborated by numerical simulations of algorithm implementation and neural network evolution. These notions offer a universal characterisation of biological intelligence emerging from evolution in terms of Bayesian model selection and belief updating.